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PREFACE 


I  selected  the  topic  of  disparity  analysis  for  my  thesis  research 
because  of  the  Importance  of  this  research  area  to  the  Air  force. 
Also,  X  have  always  been  interested  In  the  area  of  Image  processing  and 
computer  systems,  and  I  wanted  to  accomplish  an  effort  in  which  I  could 
integrate  these  two  areas  into  one  comprehensive  research  project.  By 
developing  an  Interactive  program  to  perform  disparity  analysis  of 
time 'varying  Imagery,  I  was  able  to  expand  my  knowledge  of  both  image 
processing  systems  and  computer  systems;  and,  at  the  same  time,  provide 
the  Air  Force  with  a  valuable  research  tool. 
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Implementation  of  the  interest  operators  and  the  matching  algorithm, 
and  for  his  assistance  in  obtaining  the  data  bases  used  for  processing. 
Next,  I  would  like  to  thank  Mr.  Bruce  Berley,  manager  of  the  FDP  DEC 
11/ 45  computer  operations  center,  for  the  many  valuable  hours  of 
assistance  he  rendered  when  troublesome  computer -related  systems 
Integration  problems  arose.  X  would  like  to  thank  Mr.  Charles 
E.  Vagner  for  the  development  of  the  RANTER  display  algorithms  used  in 
the  image  display  portion  of  the  program  that  was  developed.  I  would 
like  to  thank  Lt.  Donald  L.  Sander  for  his  assistance  in  obtaining  the 


photograph*  of  the  RAMTEK  image  displays. 

1  would  also  like  to  thank  Dr.  Hans  Nagel,  Dr.  William 
B.  Thompson,  Dr.  Wesley  Snyder,  and  Marsha  Jo  Hannah  for  their 
contributions,  support,  and  assistance  in  obtaining  and  implementing 
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ABSTRACT 


An  Interactive  program  (called  program  DIOA)  was  developed  to 
perform  disparity  analysis  of  time -varying  Imagery.  The  program 
consists  of  four  sections:  (1)  image  operations;  (2)  Interesting  point 
selection;  (3)  interesting  point  matching;  and  (4)  image  display. 
Three  data  bases  were  obtained:  (1)  a  20-frame  sequence  of  Images  from 
a  terrain  board  of  the  U.S.  Army  Night  Vision  Laboratory;  (2)  an 
18 -frame  sequence  of  various  moving  objects  from  the  University  of 
Minnesota;  and  (3)  a  33-frame  sequence  of  images  of  a  traffic  scene 
from  the  University  of  Hamburg. 

Each  of  the  four  program  sections  were  tested.  Image  operations 
included  printing  image  intensities,  and  image  file  creation  and 
deletion.  Three  Interest  operators  were  employed  in  the  interesting 
point  selection  section:  (1)  simple  variance;  (2)  directed  variance 
(the  Moravec  Operator);  and  (3)  edged  variance.  The  number  of 
interesting  points  selected  was  found  to  be  inversely  proportional  to 
the  Interest  operator  threshold.  A  relaxation -labeling  matching 
algorithm  was  used  in  the  interesting  point  matching  section  to  match 
interesting  points  from  two  images.  Very  poor  matching  results  were 
obtained.  Image  displays  included  black -and -white  and  color  images 
with  and  without  the  Interesting  points  overwritten.  Photographs  were 


taken  of  both  cases 


DISPARITY  ANALYSIS  OF  TIME -VARYING  IMAGERY 


I.  Introduction 

"For  our  weapons  of  warfare  are  not  carnal,  but  mighty 
through  God  to  the  pulling  down  of  strongholds." 

-  2  Corinthians  10:4 

An  enemy  tank  is  moving  about  within  a  heavily  cluttered  battle 
area.  If  the  tank  is  being  sought  by  an  airborne  munitions  platform, 
how  can  it  be  detected,  identified,  and  destroyed?  One  method  is  to 
use  disparity  analysis  to  perform  the  following  tasks:  (L)  separate 
the  moving  (dynamic)  objects  within  the  battle  area  (scene)  from  the 
stationary  (static)  background;  (2)  isolate  (segment)  the  moving 
objects  from  one  another;  (3)  identify  one  of  the  moving  objects  as  the 
enemy  tank;  and  (4)  crack  the  tank  as  it  moves  from  scene  to  scene. 
Some  type  of  munitions  may  then  be  discharged  along  the  path  of 
movement  of  the  tank  to  effect  its  destruction. 

Background 

For  the  past  several  months,  the  Information  Processing  Technology 
Branch  of  the  Air  Force  Avionics  Laboratory  (AFWAL)  has  been  actively 
engaged  in  the  development  of  a  dynamic  image  disparity  analysis  (DIDA) 
processing  system.  Under  the  current  direction  of  Dr.  Louis 


A.  Tamburino,  AFWAL/AAAT-1 ,  this  development  effort  has  moved  toward 
the  generation  of  a  computer  program  for  performing  real-time  disparity 
analysis  of  complex,  time -varying  Imagery.  This  program  development 
effort  is  an  offspring  and  expansion  of  a  program  originally  created  at 
Rome  Air  Development  Center  (RADC)  called  IPS  (for  Image  Processing 
System) . 

The  IPS  program  [Ref.  1:2],  In  its  original  form,  takes  an  image 
stored  on  an  image  file,  performs  some  processing  operation  (or 
operations)  on  it,  then  places  the  modified  image  back  onto  the  image 
file.  The  program  also  incorporates  a  data  base  management  system  for 
manipulation  of  the  stored  image  data.  Because  of  these  capabilities. 
Dr.  Tamburino  chose  the  IPS  program  to  form  a  basis  for  the  DIDA 
processing  system. 

When  the  IPS  program  was  obtained  from  RADC,  it  was  written  in 
MACRO  Assembly  Language  for  the  DEC  PDP  11/45  minicomputer.  Because  of 
the  difficulties  Involved  in  using  assembly  language,  the  program  was 
rewritten  in  a  high  level  language  (FORTRAN  IV-PLUS)  by  Mr.  Dug  Kyoo 
Choi  from  Korea,  working  in  this  country  under  a  scientific  exchange 
program  [Ref.  3].  He  structured  the  program  into  three  major 
divisions:  (1)  Data  Manipulations;  (2)  Image  Processing  System;  and 
(3)  Dynamic  Image  Disparity  Analysis.  Each  division  was  then  broken  up 
into  its  corresponding  sub-divisions  (which  he  called  Frames)  as  shown 
In  Figure  1.  The  overall  program  was  entitled  DIPS  (for  DIDA  Image 
Processing  System).  During  the  time  he  was  in  this  country,  Mr.  Choi 
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succeeded  la  programming  and  Implementing  the  first  two  major  sections 


of  the  DIPS  program. 


DIDA 
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Figure  1.  DIDA  Image  Processing  System  Structure  [Ref. 3: 10] 


The  third  section  of  the  DIPS  program  forms  the  basis  for  this 
thesis  effort.  It  is  the  portion  of  the  DIPS  program  which  actually 
performs  the  disparity  analysis  operations.  This  portion  of  the 
program  has  been  entitled  DIDA  (for  Dynamic  Image  Disparity  Analysis). 

Disparity  analysis  is  defined  to  be  the  determination  of  the 
geometric  differences  between  two  or  more  images  of  the  same  or  similar 
areas  (scenes).  When  differences  occur  between  two  or  more  Images,  the 
"disparity"  between  them  may  be  represented  as  a  vector  field  mapping 


all  of  the  various  Images  Into  Che  image  of  lnceresc.  Thus,  Che 
disparlcy  analysis  of  two  or  more  Images  resulcs  In  Che  asslgnmenc  of 
disparities,  which  are  represenced  as  mulcldlmenslonal  vecCor  fields, 
Co  a  collection  of  poincs  in  Che  image  plane.  These  disparicies  are  Chen 
used  Co  make  inferences  abouC  dynamic  feaCures  of  images  CRef.  4:3333. 

More  simply  sCaCed,  disparlcy  analysis  involves  Che  deCecdon  and 
locacion  of  dynamic  feaCures  of  an  image  by  Che  disparicies  creaCed  as 
a  resulc  of  cheir  moCion.  To  obCain  chese  disparicies,  a  sec  of 
"inCerescing"  poincs  are  formed  (selecced)  on  an  image  using  an 
lnceresc  operacor.  Once  Chese  poincs  are  decermined,  chey  are  macched 
co  Che  same  poinc  in  subsequenC  Images  using  a  matching  algorithm.  The 
difference  between  the  locacion  of  a  given  interesting  point  in  one 
image,  and  its  corresponding  locacion  in  subsequent  Images  forms  a 
disparlcy  vector  between  Che  points.  The  collection  of  all  such 
disparity  veccors  forms  Che  vector  field  which  maps  all  of  Che  Images 
into  one. 

Segmentation  is  Che  process  of  partitioning  an  image  into 
meaningful  parts  such  chat  all  points  belonging  Co  a  particular  part 
have  some  common  property  (as  Che  Cank  mentioned  on  page  1),  or  can  be 
represenced  using  a  mathematical  or  logical  predicate  [Ref.  5:13].  If 
an  object  is  moving  within  a  certain  scene,  segmentation  may  be 
accomplished  by  the  use  of  velocity  information  relating  the  time 
variation  of  the  image  intensity  of  the  interesting  points  due  to  their 
motion  to  the  spatial  variation  of  the  intensity  over  the  objects 
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surface.  A  clustering  algorithm  Is  then  applied  to  determine  the 
dominant  velocities  In  the  range  of  the  Image  apace,  and  to  classify 
each  set  of  Interesting  points  based  on  their  estimated  speed  and 
direction  [Ref  6:544]. 

The  matching  of  Interesting  points  from  Image  to  Image  Is  the  very 
heart  of  disparity  analysis  since  It  forms  the  basis  for  the  extraction 
of  all  pertinent  Information.  One  very  Important  result  of  this 
matching  process  Is  the  ability  to  delineate  object  boundaries  as  loci 
of  Interesting  points.  The  basic  Idea  Is  that  a  subset  of  the 
Interesting  points  forms  a  skeletal  template  of  the  object  within  the 
Image  area.  To  Identify  the  object  specifically  (e.g.,  as  the  tank 
mentioned  on  page  1),  this  skeletal  template  is  compared  with  the 
template  of  the  object  being  sought.  If  a  reliable  match  occurs,  then 
the  object  is  searched  for  in  a  second  (or  subsequent)  image.  When 
located,  this  newly  discovered  template  becomes  the  template  sought  In 
the  next  Image  (or  image  sequence).  This  process  continues  as  long  as 
object  tracking  is  desired. 

Because  of  the  ability  to  separate  static  and  dynamic  Image 
features,  segment  dynamic  features  from  one  another,  and  identify  and 
track  segmented  dynamic  features,  disparity  analysis  forms  an  extremely 
useful  tool  for  the  detection  and  classification  of  moving  objects 
within  cluttered  scenes.  In  the  past,  this  type  of  scene  analysis  has 
posed  serious  problems  for  conventional  pattern  recognition  algorithms. 
For  this  reason,  the  development  of  a  robust,  real-time  dynamic  Image 


disparity  analysis  processing  system  Is  of  great  Interest  to  Dr. 
Tamburlno,  and  the  United  States  Air  Force. 

Problem 

The  primary  objective  of  this  thesis  effort  was  to  develop  a 
method  for  performing  disparity  analysis  of  time^varying  Images.  Given 
a  feature  of  Interest  in  a  certain  image,  locate  this  feature  in  a 
subsequent  image  by  matching  the  interesting  points  of  the  feature  to 
the  same  interesting  points  in  the  image  of  interest.  This  involves 
applying  an  interest  operator  consecutively  to  two  or  more  subsequent 
images  and  matching  the  resulting  Interesting  points  from  each  image. 

A  second  goal  of  this  thesis  effort  was  to  investigate  the  effects 
of  Interest  operator  performance  on  matching  efficiency.  For  a 
particular  Interest  operator,  determine  the  matchability  of  the 
interesting  points  selected  compared  with  the  matching  ability  of  other 
interest  operators  for  the  same  image  sequence.  In  other  words, 
compare  the  ability  of  each  interest  operator  to  select  interesting 
points  in  a  fixed  image  sequence  that  are  easily  matched. 

The  final  objective  of  this  thesis  effort  was  to  develop  a  display 
algorithm  to  exhibit  the  Interesting  points  selected  by  the  Interest 
operators.  First,  the  image  from  which  the  interesting  points  were 
extracted  is  displayed.  Hext,  the  (x-y)  coordinate  location  of  each 
interesting  point  on  the  image  is  overwritten  by  some  symbol  which 
is  easily  distinguished  from  surrounding  points.  Finally,  the  image  is 
redisplayed  with  the  interesting  points  clearly  visible. 


From  the  moving  tank  senario  on  page  1,  it  Is  evident  that  the 


disparity  analysis  process  Involves  four  fundamental  tasks:  (1)  to 
separate  static  and  dynamic  Image  features;  (2)  to  segment  Image 
features  moving  In  relation  to  one  another;  (3)  to  specifically 
Identify  Image  features  (e.g.,  the  tank);  and  (4)  to  track  a  specific 
Image  feature  (or  features)  from  scene  to  scene.  This  thesis  effort 
was  Involved  with  only  the  first  of  these  tasks;  that  Is,  to  separate 
dynamic  and  static  Image  features  from  one  another  by  means  of  the 
disparities  created  from  a  certain  image  sequence.  The  segmentation. 
Identification,  and  tracking  of  image  features  are  each  complex  studies 
In  their  own  right,  and  could  not  be  adequately  treated  in  a  combined 
effort  over  the  period  of  time  allowed  for  this  research. 

Only  two 'Image  sequences  were  used  to  create  disparities  during 
this  study.  These  sequences  were  taken  from  three  separate  image  data 
bases  which  were  provided  from  external  sources  during  the  effort 
(these  data  bases  and  sources  are  described  more  fully  in  Chapter  II). 
Three  different  Interest  operators  were  used  to  select  Interesting 
points,  and  one  matching  algorithm  (relaxation-labeling)  was  used  to 
accomplish  Interesting  point  matching.  After  creation,  the  Interesting 
points,  along  with  other  pertinent  data,  are  stored  on  a  separate 
external  file  so  that  the  matching  algorithm  may  be  applied 
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independently  of  Interesting  point  selection.  This  places  no 
restriction  on  the  aatchlng  algorithm  as  to  the  sets  of  points  chosen 
to  be  matched  (i.e.t  the  images  whose  Interesting  points  are  being 
matched  do  not  have  to  be  exactly  time  sequential).  Thus,  any  two  sets 
of  interesting  points  from  any  two  Images  may  be  matched  regardless  of 
their  time  and  feature  correspondence.  This  is  particularly  useful  if 
the  testing  of  the  resolution  of  the  matching  algorithm  being  used  is 
desired. 

For  the  disparity  analysis  process,  image  sizes  in  the  range  from 
4x4  up  to  5  l^xC^l^)  are  permitted,  with  intensity  values  represented 
by  8-bit  bytes  in  the  range  from  0  (totally  dark)  to  255  (totally 
white).  For  interesting  point  selection,  the  processing  window  size  is 
a  function  of  the  user  specified  image  size,  with  a  range  from  2x2  up 
to  63x511  permitted.  Similarly,  the  maximum  allowable  number  of 
interesting  points  which  can  be  selected  for  a  given  image  is  a 
function  of  the  maximum  permissible  image  size,  and  is  equal  to  the 
maximum  permissible  image  column  size  specified  by  the  system  (M). 

For  matching,  the  total  size  (product  of  rows  and  columns)  of  the 
correlation  window  surrounding  each  interesting  point  for  determining 
initial  probabilities  may  not  exceed  one  third  of  the  maximum 
permissible  image  column  size  specified  by  the  system,  the  minimum 
allowable  size  being  2x2.  The  maximum  sizes  for  the  disparity  window 
for  label  computation  and  the  maximum  likelihood  neighborhood  for 
probability  updates  are  likewise  a  function  of  the  maximum  permissible 
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image  column  size.  The  permissible  range  of  che  disparity  window  is 
2x2  up  to  512x512,  and  che  same  is  true  for  che  maximum  likelihood 
neighborhood. 


Some  ocher  variables  associated  with  both  che  interest  operator 
and  matching  algorithms  may  be  specified  interactively  during  the 
disparity  analysis  process,  and  may  take  on  any  value  within  the 
allowable  Integer  or  floating  point  range  of  the  computational  system 
being  used.  In  this  case,  it  is  the  responsibility  of  the  individual 
performing  the  analysis  to  insure  that  the  appropriate  value  is 
specified. 

Finally,  for  image  input,  the  image  input  row  buffer  size  is  a 
function  of  the  maximum  permissible  image  size,  with  a  range  from  1x4 
up  to  4x512  permitted.  All  of  these  variables  are  discussed  more  fully 
in  Chapter  II.  The  functions,  ranges,  and  specifications  for  the 
above "mentioned  variables  are  sumarized  in  Table  I. 

Assumptions 

The  following  assumptions  were  made  based  on  an  analysis  of  the 
present  state-of -the -art  of  disparity  analysis: 

1.  The  Interest  operators  presented  in  the  literature  will 
perform  in  the  manner  described.  In  other  words,  the  algorithms  will 
select  interesting  points  as  described  when  they  are  Implemented  on  a 
digital  computer. 


NOTES:  3.  Computational  system  memory  size  dependent 

Specified  at  compile  time  4.  System  specified  during  program  execution 

2.  Specified  during  program  execution  5.  Value  may  exceed  M 
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2.  The  matching  algorithms  presented  in  the  literature  will 
perform  in  the  manner  described. 

3.  The  image  data  bases  receieved  from  external  sources  contain 
imagery  of  sufficient  quality  and  resolution  (except  where  stated 
otherwise)  to  yield  meaningful  results  when  processed. 

4.  The  first  two  sections  of  the  DIDA  Image  Processing  System 
computer  program  operate  as  stated. 

5.  Computer  facilities  and  equipment  necessary  to  implement, 
debug,  and  test  the  disparity  analysis  program  were  available  on  a  full 
time  basis  (excluding  normal  maintenance  down-time) . 

6.  An  operational  program  for  matching  sets  of  interesting  points 
would  be  provided  for  use. 

7.  Assistance  from  staff  personnel  at  AFWAL/AAAT-1  would  be 
available  in  the  development  of  the  image  display  algorithms. 

8.  Evaluation  criteria  exist  for  assessing  the  performance  of 
interest  operators  with  respect  to  matching  efficiency. 

Approach 

The  effort  began  with  a  literature  review  to  determine  the 
background  and  history  of  past  disparity  analysis  efforts,  as  well  as 

this,  a  structured  computer 
research  tool  for  performing 


the  present  state'-of -the-art.  After 
program  was  developed  to  provide  a 
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disparity  analysis.  Entitled  program  DIDA,  this  program  enables  the 
user  to  interactively  perform  certain  image  operations,  select 
Interesting  points  from  a  specified  image,  match  these  (or  other) 
points  to  those  of  another  image,  and  display  images  (with  or  without 
interesting  points  overwritten)  on  a  CRT.  During  this  program 
development,  three  separate  image  data  bases  were  obtained  for 
processing. 

Using  program  DIDA,  the  matching  efficiency  of  the  Moravec 
Interest  operator  was  evaluated.  Also,  photographs  were  taken  of  the 
sets  of  Images  which  were  used  to  test  the  Interest  operators.  First, 
a  photograph  of  the  original  image  was  taken,  then  a  photograph  was 
taken  of  the  image  with  the  interesting  points  overwritten.  A  visual 
inspection  was  used  to  determine  if  the  points  were  matched  for  image 
sets  on  which  matching  was  performed. 

Sequence  of  Presentation 

The  sequence  of  presentation  of  the  thesis  material  is  both 
logical  and  functional.  Chapter  II  provides  a  general  description  of 
the  DIDA  computer  program.  Sections  I  and  IV  of  the  program  are 
described  in  detail  since  they  are  fairly  short.  Sections  II  and  III 
of  the  program  describe  the  interesting  point  selection  and  matching 
sections  respectively,  and  are  only  generally  described  in  Chapter  II 
of  the  report.  Chapter  III  describes  the  interesting  point  selection 
algorithms  utilized  by  program  DIDA  in  detail;  whereas  Chapter  IV 
describes  the  interesting  point  matching  algorithm. 
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The  results  and  conclusions  of  the  effort  are  detailed  In  Chapter 
V.  A  comparison  of  the  number  of  Interesting  points  produced  versus 
threshold  is  given,  along  with  a  comparison  of  the  matching  efficiency 
of  the  Moravec  interest  operator.  Photographs  of  images  from  each  of 
the  three  data  bases  are  shown.  Also,  photographs  of  two  separate 
images  with  the  interesting  points  overwritten  are  shown.  The  thesis 
report  concludes  with  some  recommendations  for  further  study  contained 
in  Chapter  VI. 


II.  Program  OIDA:  General  Description 


As  mentioned  In  the  background  portion  of  the  Introduction 
section,  the  DIDA  program  is  to  be  the  third  major  section  of  the  DIPS 
program.  The  overall  structure  of  the  DIPS  program  is  shown  in  block 
diagram  form  in  Figure  2. 


matching;  and  (4)  image  display.  The  overall  structure  of  the  DIDA 
program  is  shown  in  block  diagram  form  in  Figure  3.  A  glossary  of  the 
symbols,  variables,  and  arrays  used  in  the  program  is  shown  in  Appendix 
A,  along  with  a  brief  description  of  their  function.  The  main  control 
program  listing  for  the  DIDA  program  is  shown  in  Appendix  B. 


Program  DIDA  was  developed  using  a  top-down,  structured  analysis 
and  design  technique  similar  to  the  one  described  by  Softech  [Ref.  7], 
Parnas's  principle  of  information  hiding  [Ref.  8:74,1271  was  used 
throughout  most  of  the  program  to  provide  a  highly  reliable  and 
maintainable  modular  program  structure.  This  was  accomplished  by  using 
labeled  COMMON  blocks  selectively  within  each  program  module  to  Include 
only  information  directly  relevant  to  that  particular  module.  In  most 
cases,  only  error  and  end  program  parameters  are  passed  as  subroutine 


arguments  within  the  program  structure. 

Program  DIDA  is  an  interactive  program  controlled  primarily  by 
user  inputs  during  execution.  The  specific  method  of  user  program 
control  is  described  during  the  associated  description  of  the  program. 
In  basic  terms,  the  user  is  asked  which  program  operation 
(corresponding  to  one  of  the  four  sections  mentioned  above)  is  desired. 
Based  on  the  information  input,  that  operation  is  then  carried  out. 
This  interactive  method  of  question/ response  is  used  generically 
throughout  the  entire  program  at  all  levels  where  a  user  input  is 
required.  Feedback  is  provided  to  the  user  after  an  information  entry 
it:  accomplished  to  enable  an  entry  conectlon,  if  desired.  Also,  user 
inputs  are  monitored  to  insure  that  nonsensical  inputs  (such  as  "YEX" 
for  "YES"),  or  inputs  outside  the  range  of  the  parameters  specified  in 
Table  I,  are  corrected.  The  operational  philosophy,  however,  is  to 
allow  the  user  to  control  the  program  operation.  In  all  cases,  the 
initial  assumption  is  that  the  user  knows  the  correct  input  to  make. 
As  long  as  the  information  input  is  within  the  correct  parameter 
bounds,  and  a  typographical  error  is  not  committed,  the  program  assumes 
that  the  user  knows  what  he  or  she  is  doing.  A  flow  diagram  depicting 
the  overall  operation  of  program  DIDA  at  the  highest  level  is  shown  in 
Figure  4. 

Each  of  the  four  major  sections  of  program  DIDA  is  now  described. 
Following  this,  each  of  the  three  data  bases  used  for  disparity 
analysis  testing  is  described. 


Figure  4.  PI DA  Program  Flow  Diagram 


Image  Operations  Section 

The  subroutine  source  listings  for  the  image  operations  section  of 
program  DIDA  are  shown  in  Appendix  C.  This  section  is  controlled  by 
subroutine  IMGOPR  which  first  allows  the  user  to  specify  the  image 
size,  then  select  the  image  operation  desired.  Three  image  operations 
are  available:  (I)  print  image  intensities  on  the  line  printer;  (2) 
delete  an  image  file;  and  (3)  create  a  new  image  file.  The  user  may 
also  terminate  image  operations  or  program  execution,  if  desired. 

Image  Size.  Images  to  be  processed  by  program  DIDA  are  stored 
externally  or  image  files.  These  files  are  created  from  image  data 
bases  obtained  by  the  digitization  of  photographs  taken  of  real -world 
scenes,  or  by  creating  them  using  one  of  program  DIDA's  image  creation 
algorithms.  Each  image  is  represented  by  an  array  of  numbers,  where 
each  number  within  the  array  (array  element)  is  a  binary  representation 
of  the  intensity  of  the  elemental  area  of  the  real  world  scene  which 
maps  to  that  location.  The  binary  representation  of  each  intensity 
array  element  (called  a  "pixel*'  -  for  picture  element)  is  an  8-bit 

Q 

field  containing  binary  numbers  from  0  (totally  dark)  to  2  -  1  *  255 
(totally  white).  Thus,  the  range  of  intensities  entering  the  digitizer 
from  the  image  photograph  is  scaled  to  this  8-bit  range  of  numbers.  In 
other  words,  each  image  pixel  is  assigned  a  number  between  0  and  255  by 
the  image  digitizer  which  is  proportional  to  its  actual  intensity. 
These  pixel  values  are  then  sequentially  output  to  a  magnetic  tape  or 
storage  disk  as  the  image  is  scanned  from  pixel  to  pixel.  This  image 
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digitization  process  is  shown  in  Figure  S. 

The  size  of  an  image  is  defined  as  the  total  number  of  pixels  it 
contains.  As  mentioned  above,  these  pixels  are  stored  in  an  intensity 
array.  This  array  is  specified  by  the  number  of  rows  and  columns  it 
contains,  and  the  product  of  these  rows  and  columns  must  equal  the 
image  size.  When  an  image  is  digitized,  the  number  of  columns  it 
contains  is  determined  by  the  number  of  pixels  required  to  span  its 
horizontal  length.  The  number  of  rows  is  determined  by  the  number  of 
pixels  required  to  span  its  vertical  width.  When  the  digitized  image 
is  stored  on  an  image  file,  it  is  stored  sequentially  from 
pixel 'to -pixel,  and  from  row-to-row.  As  a  matter  of  convention,  one 
complete  row  of  pixels  is  usually  taken  to  form  one  logical  file 
record.  Thus,  the  number  of  records  in  the  image  file  is  equal  to  the 
number  of  rows  of  the  image,  and  the  number  of  data  fields  within  each 
record  is  equal  to  the  number  of  image  columns.  Therefore,  the  product 
of  the  number  of  image  file  records  and  data  fields  within  each  record 
defines  the  image  slzefor  that  file.  Consequently,  the  number  of  rows  and 
columns  of  the  Intensity  element  storage  array  of  program  DIDA  must 
correspond  directly  with  the  number  of  rows  and  columns  (records  and 
record  fields)  of  the  image  file. 

The  image  size  is  specified  through  subroutine  1MGSZS.  This 
subroutine  requests  that  the  user  input  the  number  of  rows  and  columns 
of  the  image.  It  then  calls  subrouting  IRCFND  to  obtain  this 
information,  and  prints  it  on  the  line  printer.  The  image  size  and  its 


IMAGE 

FILES 


Inverse  are  also  printed 


Subroutine  IRCFND  calls  subroutines  IMROW  and  IMCOL  to  obtain  the 
number  of  image  rows  and  columns  respectively.  If  the  user  feels  that 
an  error  has  been  committed,  an  affirmative  response  may  be  offered 
when  querrled  for  error  checking.  If  the  user  requests  an  error  check, 
subroutine  IRCCHK  is  called.  This  subroutine  displays  the  input 
information  and  asks  the  user  if  it  is  correct.  If  a  negative  response 
is  entered,  subroutine  IRCCOR  is  called  to  allow  the  user  to  correct 
the  erroneous  input.  A  flow  diagram  illustrating  the  method  of 
inputting  the  image  row  and  column  size  is  shown  in  Figure  6. 

The  Information  obtained  after  calling  IMGSZE  is  stored  in  the  area 
COMMON  /IMAGE/  for  later  use.  The  variables  IMGROW,  IMGCOL,  IMGSZE, 
and  IMGINV  specify  the  values  obtained.  Note  that  in  each  subroutine, 
only  information  pertinent  to  the  function  performed  by  that  subroutine 
is  present.  This  exemplifies  the  principle  of  information  hiding 
mentioned  earlier.  An  illustration  of  the  manner  in  which  the  image  is 
described  by  program  DIDA  is  shown  in  Figure  7.  The  values  of  L,  M, 
and  N  are  described  in  Table  I. 

After  the  image  size  has  been  specified,  subroutine  IMGOPR  calls 
subroutine  IMOSEL  to  allow  the  user  to  select  the  image  operation 
desired.  IMOSEL  lists  the  options  available  and  the  user  enters  the 
number  corresponding  to  the  one  to  be  performed. 

Printing  Image  Intensities.  If  the  user  enters  number  one  in 
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IMOSEL,  Che  Image  operation  required  Co  print  Che  Intensity  values  of  a 
specific  Image  file  on  the  line  printer  Is  selected  (subroutine 
IM0PR1). 

This  subroutine  first  requests  that  the  user  enter  the  logical 
unit  number  and  file  name  of  the  Image  file  to  be  printed.  Subroutine 
FLUFND  Is  then  called  to  obtain  this  Information  from  the  user.  This 
subroutine  calls  subroutines  LUNBR  and  F1LENM  to  obtain  the  logical 
unit  number  and  file  name  respectively.  As  In  the  case  of  the  image 
size,  the  user  Is  asked  if  entry  checking  Is  desired.  If  so, 
subroutine  FLUCHK  Is  called.  Error  correction  is  then  accomplished  by 
subroutine  FLUCOR,  If  needed.  This  file  information  Is  stored  In  the 
area  COMMON  /FILE/  and  specified  by  the  variables  LUN  and  FNAME.  FNAME 
is  a  34  element  byte  array  which  stores  the  alphanumeric  literal 
specifying  the  file  name.  A  flow  diagram  Illustrating  the  method  of 
inputting  the  logical  unit  number  and  file  name  Is  shown  in  Figure  8. 

Once  the  logical  unit  number  and  file  name  have  been,  specified, 
IM0PR1  calls  subroutine  OPNOLD  which  opens  an  unformatted,  direct 
access,  sequential  file  which  was  previously  created  (l.e.,  already  in 
existance).  The  variables  IMGROW  and  IMGCOL  previously  specified  are 
used  to  determine  the  number  of  records  and  record  length  respectively. 


Subroutine  INPUT  is 

called 

after 

the  file 

is 
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IOBUFR.  This  array  is  located  in  the  area  COMMON  /BUF/. 
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In  order  Co  print  Che  Intensity  data,  it  Is  necessary  to  convert 
the  8 'bit  intensity  fields  stored  on  each  logical  record  to  a  16 'bit 
data  word  to  be  compatible  with  the  format  accepted  by  the  line 
printer.  It  could  be  assumed  that  all  that  is  necessary  to  accomplish 
this  conversion  is  to  merely  establish  equivalence  between  the  8'bit 
array  and  a  16'bit  array.  Unfortunately,  the  conversion  process  is  not 
quite  that  simple.  The  problem  results  from  the  form  the  data  assumes 
when  it  is  stored  on  the  image  file.  Recall  that  each  record  field  is 
an  8 'bit  number  between  0  and  255.  When  the  computer  reads  an  8 'bit 
number,  it  assumes  that  it  may  be  either  positive  or  negative  in  the 
range  from  -128  to  +127.  If  an  8'bit  number  greater  than  127  is  input, 
the  computer  treats  this  as  a  negative  number  because  it  changes  the 
sign  bit  of  the  byte  memory  storage  location  in  which  the  8'bit  number 
is  stored.  Thus,  it  is  necessary  to  convert  the  8-bit  intensity  value 
to  the  correct  16 'bit  data  word  if  the  number  input  is  greater  than 
127.  This  byte-to'word  number  conversion  procedure  is  explained  in 
Appendix  G. 

After  this  byte 'to 'word  number  conversion  process  has  been 
accomplished,  the  data  is  output  to  the  line  printer  and  printed. 
Array  INTBUF  is  the  16'blt  array  used  to  store  the  converted  8'bit  data 
in  the  area  COMMON  /INBUF/.  Upon  completion  of  data  printing,  the 
image  file  is  closed  using  subroutine  CLOSKP.  This  subroutine  closes 
the  file  with  the  DISPOSE  *  'KEEP'  option  specified  so  that  it  will  not 
be  deleted. 
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File  Deletion,  If  the  user  enters  the  number  two  in  IMOSEL,  the 
image  operation  required  to  delete  an  existing  image  file  is  selected 
(subroutine  IM0PR2).  The  logical  unit  number  and  filename  are 
specified  by  subroutine  FLUFND,  and  subroutine  OPNOLD  opens  the  file. 
After  this,  subroutine  CLOSDL  is  called  with  the  DISPOSE  ■  'DELETE' 
option  specified.  This  deletes  the  file. 

Image  Creation.  If  the  user  enters  the  number  three  in  IMOSEL,  the 
image  operation  required  to  create  a  new  image  file  is  selected 
(subroutine  IMOPR3).  Again,  the  logical  unit  number  and  file  name  are 
specified  by  subroutine  FLUFND  interactively.  Rowever,  this  time 
subroutine  OPNNEW  rather  than  OPNOLD  is  called.  OPNNEW  opens  a  new 
unformatted,  direct  access,  sequential  file  whose  record  size  and 
number  of  records  are  specified  by  the  values  of  IMGCOL  and  IMGROW 
respectively.  Subroutine  OPNNEW  may  also  open  an  existing  file  for 
modification,  if  desired. 

After  opening  the  file,  subroutine  IMASEL  is  called.  This 
subroutine  allows  the  user  to  select  the  algorithm  (method)  to  be  used 
to  find  the  intensity  values  of  the  pixels  of  the  new  image  to  be 
created.  Three  algorithms  are  available:  (1)  random  intensity 
distribution;  (2)  user  terminal  input;  and  (3)  card  reader  input.  The 
user  may  also  terminate  program  execution,  if  desired.  When  the  new 
image  has  been  created,  subroutine  IM0PR3  closes  the  image  file  using 
subroutine  CLOSKP.  Subroutines  IM0PR4  and  IM0PR5  are  not  used  at  the 
present  time. 
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Random  Intensity  Distribution.  If  the  user  enters  the  number  one 
In  IMASEL,  the  Image  creation  algorithm  required  to  create  an  Image 
with  a  random  intensity  distribution  is  selected  (subroutine  IMALG1). 
This  subroutine  assigns  randomly  selected  values  between  0  and  255  to 
the  image  elements  of  the  image  being  created.  This  is  accomplished 
using  the  FORTRAN  subprogram  RAN(SEED),  where  SEED  is  an  INTEGER*4 
seeding  number  for  the  random  number  generator. 

Subroutine  IMALGl  first  calls  subroutine  SEEDFD  to  allow  the  user 
to  interactively  specify  the  desired  value  of  SEED.  Again  error 
checking  is  performed.  Each  different  value  of  SEED  produces  a  new 
random  number  sequence.  Since  the  random  number  subprogram  produces  a 
number  between  0  and  l,  multiplying  its  output  by  256  will  produce  the 
necessary  intensity  range.  Since  only  integer  numbers  are  used,  and 
"1"  is  never  output  by  RAN,  the  largest  number  which  can  result  Is  255. 
Also,  numbers  less  than  1  will  be  truncated  to  "0"  (zero).  Thus,  the 
desired  range  is  obtained. 

After  each  random  intensity  value  is  generated,  it  is  stored  in 
array  INTBUF.  This  value  is  then  copied  into  array  I0BUFR  for  output 
to  the  image  file.  When  an  entire  row  of  intensity  values  has  been 
stored  in  one  row  of  I0BUFR,  subroutine  OUTPUT  is  called.  This 
subroutine  outputs  the  row  of  intensity  data  to  the  image  file  record 
specified  by  the  value  of  RECNUM.  If  the  debug  program  version  is 
being  executed  (see  Chapter  V),  these  values  are  also  printed  on  the 


line  printer 


User  Terminal  Input.  If  the  user  enters  the  number  two  in  IMASEL, 
the  image  creation  algorthim  required  to  create  an  image  using  the 
user's  terminal  is  selected  (subroutine  IMALG2).  This  subroutine 
allows  the  user  to  interactively  enter  the  intensity  values 
corresponding  to  the  pixels  of  the  new  image  being  created.  The  user 
is  asked  to  enter  the  intensity  values  one  record  at  a  time,  and  is 
then  given  information  on  how  to  enter  the  numbers.  Each  record  is 
terminated  with  a  slash  (/),  and  a  carriage  return  (CR).  The  user 
specified  intensity  values  are  then  stored  in  one  row  of  array  IOBUFR 
and  written  to  the  image  file  with  subroutine  OUTPUT.  They  are  also 
printed  on  the  printer  if  the  debug  program  is  used. 

Card  Reader  Input.  If  the  user  enters  the  number  three  in  IMASEL, 
the  image  creation  algorithm  required  to  create  an  image  using  the  card 

reader  is  selected  (subroutine  IMALG3) .  This  subroutine  allows  the 

user  to  input  the  intensity  values  corresponding  to  the  pixels  of  the 
new  image  being  created  using  cards.  Each  card  contains  several 

intensity  values.  When  the  computer  encounters  a  slash,  an 

end -of -record  i3  indicated.  This  record  is  then  stored  in  one  row  of 
array  IOBUFR,  and  then  written  to  the  image  file  using  subroutine 
OUTPUT.  If  an  error  occurs  during  card  reader  entry,  the  file  is 
closed  using  subroutine  CLOSDL.  The  Input  Intensity  values  are  also 
printed  on  the  printer  If  the  debug  program  is  used.  To  perform  image 
operations,  then,  it  Is  necessary  to  just  define  the  image  size.  Next, 
the  desired  operation  is  selected.  Finally,  If  Image  creation  is 
desired,  the  image  creation  algorithm  to  be  used  is  selected. 


»  —  -M- 


•As* 


29 


Subroutines  IMALG4  and  IMALG5  are  not  used  at  the  present  time.  An 
overall  flow  diagram  of  the  image  operations  section  of  program  D1DA  is 
shown  in  Figure  9.  Refer  to  Figure  6  and  8  for  a  more  detailed  diagram 
of  the  image  size  and  file  description  processes. 

Interesting  Point  Selection  Section 

The  subroutine  source  listings  for  the  interesting  point 
selection  section  of  program  DIDA  are  shown  in  Appendix  D.  This  section 
is  controlled  by  subroutine  INTPTS.  As  in  the  image  operations 
section,  the  image  size  is  defined  first.  Next,  the  size  of  the 
processing  window  to  be  used  to  select  the  interesting  points  is 
defined.  After  this,  several  rows  of  the  image  to  be  processed  are 
input  depending  upon  the  window  size.  The  user  is  next  asked  if  the 
Interesting  points  are  to  be  stored  on  an  output  file.  If  an 
affirmative  response  is  offered,  the  correlation  window  size  is 
defined,  and  a  scratch  file  for  storing  the  correlation  windows 
surrounding  each  interesting  point  selected  is  opened.  If  the  user 
does  not  wish  to  store  the  interesting  points,  these  steps  are  skipped. 

Once  these  initial  "set-up"  operations  have  been  performed,  one  of 
three  interest  operators  is  selected  to  find  the  interesting  points  on 
the  selected  image.  These  interest  operators  are:  (1)  simple 
variance;  (2)  directeu  variance;  and  (3)  edged  variance.  The 
interesting  points  of  the  image  are  then  found  using  the  selected 
operator.  If  the  user  indicated  that  the  interesting  points  should  be 
stored,  a  logical  unit  number  and  file  name  are  specified,  and  the 
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output  file  for  storing  them  is  opened.  The  interesting  points,  along 
with  their  corresponding  correlation  windows  (used  for  matching)  and 
other  associated  information,  are  then  written  to  the  file.  If  the 
user  does  not  specify  interesting  point  storage,  these  steps  are 
skipped. 

Finally,  the  user  is  asked  if  the  interesting  points  should  be 
listed  on  the  line  printer.  If  an  affirmative  response  is  entered,  the 
points  are  listed;  otherwise,  they  are  not.  Thus,  the  user  has  the 
options  of  either  storing  the  interesting  points  on  an  output  file, 
listing  them  on  the  line  printer,  or  both  (or  neither). 

In  the  following  subjections,  each  of  the  major  operations 
associated  with  the  interesting  point  selection  section  is  discussed. 
As  mentioned  in  the  sequence  of  presentation  section  of  the 
introduction,  the  interesting  point  selection  algorithms  are  only 
generally  described  in  this  section.  These  algorithms  are  described  in 
detail  in  Chapter  III.  Also,  the  definition  of  the  image  size  was 
discussed  in  the  image  operation  section  above,  and  will  not  be 
repeated  here. 

Window  Size.  In  order  to  select  interesting  points  on  a  given 
image,  a  window  of  various  sizes  may  be  passed  over  the  image  to  "look 
at"  small  sections  of  the  image  one  at  a  time.  If  an  interesting 
feature  of  the  image  is  found  within  this  section,  an  interesting  point 
may  be  defined  to  exist  there.  Thus,  before  interesting  point 
processing  can  proceed,  it  is  necessary  to  determine  the  size  of  the 
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window  Co  be  passed  over  Che  image  of  inceresc. 

Specif icacion  of  Che  window  size  for  processing  is  accomplished  in 
exactly  Che  same  manner  as  Che  specif icacion  of  Che  image  size. 
SubrouCine  WNDSZE  calls  subroucine  WRCFND  co  obcain  Che  number  of 
window  rows  and  columns.  Subroucine  WRCFND  calls  subrouCines  WDROW  and 
WDCOL  co  permic  che  user  Co  inCeracdvely  enCer  Che  number  of  window 
rows  and  columns  respeccively.  SubrouCines  WRCCHK  and  WRCCOR  are  used 
for  encry  error  checking  and  correcdon,  if  needed.  The  flow  diagram 
for  inpuccing  che  window  row  and  column  size  is  idenCical  Co  Che  one 
shown  in  Figure  6. 

The  informaCion  obcained  afcer  calling  WNDSZE  is  scored  in  Che 
area  COMMOM  /WINDOW/  for  laCer  use.  The  variables  WNDROW,  WNDCOL, 
WNDSZE,  and  WNDINV  specify  exacCly  the  same  InformaCion  as  Che 
corresponding  image  variables.  Two  new  variables  are  associated  with 
Che  window  chat  were  noC  used  for  the  image.  These  are  WNDRWH  and 
WNDCLH.  These  variables  contain  Che  values  WNDROW/2  and  WNDCOL/2 
respeccively,  and  are  used  to  locate  the  center  of  the  window.  These 
variables  are  also  stored  in  the  area  COMMON  /WINDOW/.  An  illustration 
of  the  manner  in  which  the  window  is  described  by  program  DIDA  is  shown 
in  Figure  10.  The  values  of  M  and  N  are  described  in  Table  I. 

The  maximum  value  that  WNDCOL  can  take  on  (i.e.,  that  is  permitted 
to  be  entered  by  subroutine  WDCOL)  is  equal  Co  Che  number  of  columns 
input  for  the  image  (IMGCOL)  minus  one.  Since  the  maximum  value  that 
IMGCOL  can  Cake  on  is  M,  then  the  maximum  value  that  WNDCOL  can  take  on 
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when  IMGCOL  is  at  its  maximum  value  is  M-l.  Similarly,  Che  maximum 
number  of  rows  which  may  be  inpuc  before  Che  lncensicy  array  scorage 
space  is  exceeded  is  2N.  The  maximum  value  chac  WNDROW  can  Cake  on  is 
restricted  by  subroutine  WDROW  Co  2N -1 .  The  reason  chac  one  is 
subtracted  from  Che  absolute  maximums  in  both  cases  is  Chat  it  is 
assumed  chat  when  the  user  specified  a  window  size,  a  processing 
operaclon  is  desired.  This  implies  window  movement.  Reducing  the 
window  row  and  column  size  by  one  allows  for  movement  of  one  pixel  in 
each  direction. 

Image  Input .  Ideally,  it  would  be  efficacious  to  be  able  to  input 
an  entire  image,  regardless  of  its  size,  into  an  intensity  storage 
array  within  program  DIDA  during  execution.  However,  due  to  the  memory 
storage  size  restrictions  Imposed  by  the  computational  system  being 
used  (a  DEC  PDP  IL/45  minicomputer),  this  is  not  possible  for  large 
Images.  The  maximum  amount  of  memory  available  for  program  storage 
during  execution  (Including  other  system  overhead  storage  requirements 
such  as  error  checking  programs)  is  32K  (32768)  storage  locations. 
Each  location  contains  a  16 -bit  data  word,  and  each  of  these  rords 
contains  2  8-bit  bytes.  Thus,  for  rather  large  programs  (such  as 
program  DIDA),  the  amount  of  array  storage  space  is  severely  limited 
due  to  the  program  size. 

The  memory  storage  problem  can  be  alleviated  somewhat  in  two  ways: 
(l)  divide  the  program  up  into  segments,  and  use  virtual  addressing  to 
overlay  portions  of  the  program,  and  (2)  use  a  VIRTUAL  storage  array  to 
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map  outside  the  memory  location  in  which  the  program  is  running  to 
another  32K  memory  storage  area  which  may  be  totally  used  for  storing 
intensity  values  in  an  intensity  array  (or  any  other  information).  To 
accomplish  program  overlays  (see  DEC  Manual  for  a  more  detailed 
discussion),  it  is  first  necessary  to  divide  the  program  up  into 
segments  which  are  functionally  independent  of  each  other.  A  root 
segment  (DIDA  control  program)  is  left  in  core  (bipolar  memory)  at  all 
times  during  program  execution.  This  Root  program  contains  information 
common  to  all  the  overlay  segments  (e.g.,  the  COMMON  block  data).  As 
program  execution  proceeds,  these  segments  are  brought  into  core  from 
their  storage  location  on  the  system  disk,  under  operating  system 
control  (RSX-llM),  in  accordance  with  the  overlay  structure  specified 
during  the  building  of  the  task  program.  When  a  certain  segment  has 
performed  its  function  (finished  executing),  it  is  taken  out  of  core 
and  another  segment  is  brought  in  and  executed.  This  process  continues 
until  the  execution  of  the  entire  DIDA  program  is  terminated  by  the 
user.  Since  the  DIDA  program  was  developed  as  a  top-down  structured 
program,  it  readily  lends  itself  to  being  broken  up  into  overlay 
segments  which  are  similar  to  the  program  structure. 

Even  though  a  great  savings  in  memory  storage  space  is  realized 

using  overlays,  it  is  still  not  sufficient  to  provide  enough  array 

space  for  image  storage.  To  obtain  even  more  storage  space,  a  VIRTUAL 

array  is  used.  Since  a  machine  with  a  16-bit  wordlength  is  being  used, 

16 

the  largest  amount  of  memory  space  which  can  be  mapped  is  64K  (2  - 
65S36)  8-blt  bytes.  Since  16-bit  words  are  being  used,  this  means  32K 
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words  are  available  for  Che  program  (as  mentioned  above).  However, 
several  of  these  32K  storage  locations  exist  within  the  overall  core 
memory  structure  of  the  computer  to  provide  for  multiuser  operation. 
This  means  that  simultaneous  tasks  may  be  executed  on  the  system  by  the 
operating  system  up  to  the  number  of  32K  memory  sections  available.  It 
also  means  that  these  other  32K  sections  can  be  made  available  for  use 
by  a  task  executing  in  a  different  32K  section  by  using  a  VIRTUAL 
array.  When  a  VIRTUAL  array  is  specified  within  a  program  task,  this 
flags  the  operating  system  to  specify  a  4K  register  in  the  task  program 
(called  a  window)  to  be  used  to  map  outside  the  task  program  to  another 
32K  area.  This  storage  space  is  totally  available  to  the  task  program. 
Thus,  at  the  expense  of  4K  of  space  within  the  task  program,  another 
32K  of  array  storage  space  is  obtaineed  .  The  drawback,  of  course,  is 
slower  execution  time  (not  a  big  factor  since  a  real-time  program  was 
not  the  aim  of  this  particular  study).  The  structure  of  the  overlay 
and  VIRTUAL  array  storage  scheme  is  shown  symbolically  in  Figure  II. 

For  extremely  large  images,  however,  even  overlaying  the  program 
and  using  a  VIRTUAL  array  is  not  sufficient  to  provide  enough  storage 
space  to  contain  the  entire  image.  For  example,  for  a  512X512  image 
(the  largest  considered  for  program  DIDA) ,  262144  words  of  array  space 
would  be  required  to  store  the  entire  image.  Since  this  much  storage 
space  is  not  available,  it  is  necessary  to  buffer  the  image  into  the 
program  in  sections  as  it  is  processed.  Recall  that  for  processing,  a 
window  is  moved  across  the  image  from  column -to -column  and  row-to-row. 
Thus,  processing  is  accomplished  by  scanning  the  image  from 


left -to -right,  and  from  top-to-bottom  with  the  window.  After  the 
window  has  made  one  complete  sweep  across  the  image  horizontally  (from 
left-to-right) ,  it  is  moved  back  to  the  left  edge  of  the  image  again 
and  moved  down  one  row  from  its  previous  position.  It 
is  then  again  swept  across  the  image  horizontally,  moved  back  to  the 
left,  and  moved  down  another  row.  This  process  continues  until  the 
window  reaches  the  lower  right  hand  corner  of  the  image.  This  window 
movement  process  is  shown  pictorially  in  Figure  12  (a)  thru  (i). 

Once  the  window  has  made  one  complete  horizontal  sweep  across  the 
image  and  moves  down  one  row,  the  row  that  it  leaves  when  it  moves  down 
is  no  longer  needed.  Therefore,  the  method  of  image  input  decided  upon 
is  to  replace  each  row  of  image  data  below  the  window  as  processing 
progresses.  In  other  words,  since  the  image  cannot  remain  static  in 
memory  while  the  window  moves  across  it,  the  window  is  passed  across 
the  image  from  left-to-right,  then  moved  back  to  the  left  again.  The 
uppermost  row  of  image  data  just  processed  is  replaced  with  the  next 
row  just  below  the  window.  So,  in  effect,  the  window  moves  back  and 
forth  in  a  stationary  path  while  rows  of  data  within  it  are  replaced  as 
they  are  processed  in  a  row  rotation  fashion. 

To  explain  thl3  process  in  more  detail,  refer  to  the  illustrations 
of  the  method  of  image  input  during  processing  shown  in  Figure  13  (a) 
thru  (o).  Figure  13(a)  shows  the  configuration  of  the  system  at  the 
beginning  of  image  processing.  This  corresponds  to  the  window  position 
shown  in  Figure  12(a).  The  portion  of  the  image  within  the  area 
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Figure  11.  DIDA  Program  Overlay  and  Virtual  Array  Structure 


covered  by  the  window  In  the  upper  left  corner  of  the  image  Is  now 
processed.  The  window  Is  advanced  horizontally  one  column  position  and 
that  corresponding  window  area  is  processed.  This  window  movement 
continues  until  the  window  reaches  its  rightmost  position  on  the  image 
as  illustrated  in  Figure  12  (b)  and  (c).  After  the  rightmost  window 
position  is  processed,  the  window  should  move  back  to  the  left  edge  of 
the  window  and  down  one  row  as  shown  in  Figure  12(d).  In  actuality, 
rather  than  moving  the  window  down  one  row,  the  first  row  of  the 
intensity  array  across  which  the  window  moves  is  replaced  with  the 
first  row  of  the  input  buffer  array  as  shown  in  Figure  13(b).  Since 
this  row  was  processed  on  the  first  pass  of  the  window  across  the 
array,  it  is  no  longer  needed  for  processing.  The  first  row  of  the 
input  buffer  corresponds  to  the  row  of  the  image  which  was  just  below 
the  window  when  the  window  was  at  the  top  of  the  image.  Thus, 
replacing  the  first  row  of  the  intensity  array  with  the  first  row  of 
the  input  buffer  has  the  same  effect  as  actually  moving  the  window  down 
one  row  on  the  image.  After  this  row  change  operation  has  taken  place, 
the  window  is  again  moved  across  the  intensity  array  horizontally  as 
processing  continues  as  shown  in  Figure  12  (e)  and  (f).  Although  the 
sequence  of  window  movements  shown  in  Figure  12  is  not  actually  taking 
place  in  the  manner  portrayed,  it  is  convenient  to  think  of  the 
movement  as  taking  place  in  this  fashion  to  avoid  confusion. 

As  processing  continues,  successive  rows  of  data  within  the 
intensity  array  are  replaced  with  rows  of  data  from  the  input  buffer 
as  shown  in  Figure  13  (c),  (d),  and  (e).  When  the  last  row  of  data 
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from  Che  Input  buffer  has  been  used,  this  buffer  is  refilled  with  L 
(see  Table  I)  more  rows  of  data  from  the  image  file  (assuming  the  end 
of  the  image  is  not  reached)  as  shown  in  Figure  13(f).  Processing  then 
continues  as  it  did  before  the  buffer  was  refilled.  Now,  however,  rows 
of  data  are  taken  starting  from  the  first  buffer  row  again  as  shown  in 
Figure  13  (g)  thru  (1).  Note  that  after  the  input  buffer  is  refilled 
the  first  time,  there  is  no  longer  a  one-to-one  correspondence  between 
the  input  buffer  rows  and  the  intensity  array  rows  being  replaced. 
Noce  also  in  Figure  13  (i)  and  (j)  that  after  the  last  window  row  of 
data  has  been  replaced,  the  row  change  operation  begins  at  the  top  row 
of  the  intensity  array  once  again. 

Finally,  after  enough  rows  of  data  have  been  input  from  the  image 
file,  the  next  time  the  input  buffer  is  refilled  the  last  image  row 
will  be  input.  This  is  shown  for  the  last  two  image  rows  (arbitrary 
choice)  in  Figure  13  (1)  and  (m) .  The  window  is  then  passed  across  the 
intensity  array  two  more  times  to  complete  the  processing  as  shown  in 
Figure  13  (n)  and  (o).  Figure  13(o)  corresponds  to  the  last  pass  of 
the  window  across  the  image  as  shown  in  Figure  12  (g),  (h),  and  (i). 
Thus,  as  the  window  is  moved  back  and  forth  across  the  intensity  array, 
rows  of  data  within  the  array  are  replaced  with  rows  of  data  from  the 
input  buffer  in  a  row  rotation  fashion  until  the  last  image  row  has 
been  processed. 

In  program  DIDA,  the  image  input  process  is  begun  after  the  image 
and  processing  window  sizes  have  been  specified  by  calling  subroutine 
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IMGIN.  This  subroutine  first  calls  subroutine  FLUFND  to  allow  the  user 
to  specify  the  logical  unit  number  and  file  name  of  the  image  file  to 
be  processed,  as  shown  in  Figure  3.  Next,  subroutine  OPNOLD  is  called 
to  open  the  file  for  input.  After  this,  several  rows  of  image  data  are 
input  into  the  VIRTUAL  array  INT  (beginning  with  the  first  row)  by 
calling  subroutine  INPUT.  The  number  of  image  rows  input  is  equal  to 
the  value  of  WNDROW.  If  the  debug  program  is  being  executed,  these 
data  rows  are  also  printed  on  the  line  printer. 

After  the  intensity  array  has  been  initialized,  the  next  L  rows  of 
image  data  succeeding  the  ones  input  into  INT  are  read  into  the  input 
buffer  IOBUFR  by  calling  subroutine  BUFRIN.  The  operation  of 
subroutine  BUFRIN  is  explained  in  more  detail  in  a  later  section. 
Program  DIDA  is  now  ready  to  begin  processing  with  the  system  state  as 
shown  in  Figure  13(a). 

The  dimension  of  the  VIRTUAL  Intensity  storage  array  INT  is  2N  X 
M.  The  reason  that  2N  is  used  is  because  INT  is  an  array  of  integer 
numbers  .  In  program  DIDA's  main  control  program  (also  called  PROGRAM 
DIDA),  a  generic  VIRTUAL  storage  array  STORE  of  dimension  N  X  M  is 
declared.  This  array  is  a  REAL*4  array  in  the  main  program.  It  is 
declared  a  REAL* 4  array  because  it  is  also  used  in  the  Interesting 
point  matching  section  of  program  DIDA  to  store  the  labels  and 
probabilities  (and  other  information)  associated  with  the  matching 
algorithm.  Since  some  of  this  data  is  REAL*4 ,  the  array  must  be 
declared  REAL*4  in  the  main  program  to  allocate  that  much  VIRTUAL  array 


space  (Figure  11).  Each  REAL*4  variable  contains  two  16-bit  data 
words.  Thus,  if  32K  words  may  be  mapped  in  a  VIRTUAL  array,  then  only 
16K  (16384)  REAL*4  values  may  be  stored.  Since  the  largest  value  that 
IMGCOL  will  take  on  for  any  given  image  to  be  processed  is  512,  the 
maximum  value  that  N  can  take  on  is  16384/512  *  32. 

When  the  VIRTUAL  storage  array  STORE  is  passed  to  the  interesting 
point  selection  section  of  program  DIDA  from  the  main  program,  it  is 
then  only  used  to  store  Integer  values  in  the  range  from  0  to  255. 
Each  intensity  value  requires  only  one  16-bit  word  for  storage  after  it 
has  been  converted  from  its  8-bit  representation  on  the  image  file  (see 
Appendix  G).  Since  only  one  16-bit  word  is  required  for  each  array 
location,  32K  (32768)  VIRTUAL  array  locations  are  available  for  storage 
of  the  intensity  values.  The  maximum  image  column  size  M  is  set  to  the 
largest  value  that  IMGCOL  will  take  on  for  any  image  to  be  processed 
(512).  This  leaves  the  maximum  number  of  rows  available  as  32768/512  * 
64.  However,  N  is  assigned  a  value  of  32  in  the  main  program.  Thus, 
the  VIRTUAL  array  INT  is  dimensioned  2N  X  M  in  the  interesting  point 
selection  sections. 

Interesting  Point  Selection.  After  the  image  and  processing  window 
sizes  have  been  described,  and  the  intensity  array  and  input  buffer 
have  been  initialized  with  image  data,  program  DIDA  asks  the  user  if 
the  storage  of  the  selected  interesting  points  is  desired.  If  a 
negative  response  is  given.  Interesting  point  processing  begins.  If 
the  user  requests  interesting  point  storage  (affirmative  response),  it 
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is  assumed  chat  the  points  are  being  stored  for  a  later  matching 
operation  (Chapter  IV).  One  of  the  major  features  of  the  matching 
algorithm  is  assigning  initial  probabilities  to  the  labels  associated 
with  each  candidate  match  point.  These  probabilities  are  then 
iteratively  updated  to  determine  the  points  which  match.  To  assign  the 
initial  probabilities  for  matching,  a  window  is  formed  around  each 
interesting  point  selected  for  both  sets  of  interesting  points  being 
matched.  For  points  in  each  set  which  are  in  close  proximity  to  one 
another,  their  corresponding  windows  are  compared  (correlated)  in  one 
of  a  number  of  ways  (the  exact  correlation  method  to  be  used  is 
specified  by  the  user  during  program  execution).  The  initial 
probabilities  for  matching  are  assigned  based  on  the  correlation  of  the 
two  windows  compared. 

If  the  user  has  specified  interesting  point  storage,  as 
interesting  points  are  located  during  processing,  their  correlation 
windows  are  stored  on  a  temporary  "scratch"  file  for  later  retrieval. 
This  is  done  because  there  is  not  sufficient  storage  space  in  core  to 
store  all  the  windows  for  all  the  interesting  points.  The  size  of  the 
correlation  window  to  be  placed  around  each  interesting  point  when 
located  is  specified  by  the  user  in  subroutine  CWDSZE.  This  subroutine 
is  called  by  INTPTS  after  the  user  requests  interesting  point  storage. 
Specification  of  the  correlation  window  size  is  accomplished  in  exactly 
the  same  manner  as  the  specification  of  the  processing  window  size  for 
interesting  point  selection.  Subroutine  CWDSZE  calls  subroutine  CRCFND 
to  obtain  the  number  of  correlation  window  rows  and  columns.  CRCFND 
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then  calls  CWROW  and  CWCOL  to  permit  the  user  to  interactively  enter 
the  number  of  correlation  window  rows  and  columns  respectively. 
Subroutines  CRCCHK  and  CRCCOR  are  used  for  entry  error  checking  and 
correction,  if  needed.  The  flow  diagram  for  inputting  the  correlation 
window  row  and  column  size  is  Identical  to  the  one  shown  in  Figure  6. 

The  information  obtained  after  calling  CWDSZE  is  stored  in  the 
area  COMMON  /CORWND/  for  later  use.  The  variables  CWDROW,  CWDCOL, 
CWDRWH,  CWDCLH,  CWDSZE,  and  CWDINV  specify  exactly  the  same  information 
as  the  corresponding  processing  window  variables.  However,  the 
variables  CWDRWH  and  CWDCLH  are  equal  to  CWDROW/2+l  and  CWDCOL/ 2+ L 
respectively.  The  values  of  CWDROW  and  CWDCOL  are  restricted  by 
subroutines  CWROW  and  CWCOL  such  that  etui  product  of  both  values  does 
not  exceed  M/3.  This  was  just  an  arbitici-y  choice  to  keep  the 
correlation  window  size  from  becoming  excessive.  The  range  of  values 
for  the  correlation  window  to  be  specified  is  shown  in  Table  I. 

After  the  correlation  window  size  is  defined,  a  temporary 
"scratch"  file  is  opened  for  storing  the  correlation  windows  surroudlng 
each  Interesting  point  using  subroutine  OPNCWF.  This  subroutine  opens 
a  formatted,  sequential  scratch  file  with  the  default  filename.  A 
logical  unit  number  different  than  the  one  associated  with  the  image 
file  is  automatically  assigned  to  this  file  to  prevent  errors. 

When  the  image,  processing  window,  and  correlation  window  sizes 
have  been  specified,  the  Intensity  array  and  input  buffer  initialized, 
and  the  correlation  window  file  opened,  interesting  point  processing 
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can  begin.  This  processing  begins  when  INTPTS  calls  subroutine  IOPSEL. 
Subroutine  IOPSEL  requests  that  the  user  enter  the  number  corresponding 
to  the  interest  operator  to  be  used  to  find  the  interesting  points  on 
the  selected  image.  Three  operators  are  presently  available:  (1) 
simple  variance  (I0P1);  (2)  directed  variance  (I0P2);  and  (3)  edged 
variance  (I0P3).  I0P4  thru  IOPLO  are  not  used.  Also,  the  user  may 
terminate  interesting  point  processing  or  program  execution,  if 
desired.  The  Interest  operator  number  selected  is  stored  in  the  area 
COMMON  /IOP /  in  the  variable  IOPNBR.  This  area  also  contains  the 
variable  IP FLAG  which  flags  the  storage  of  the  interesting  points  when 
set  to  l.  A  detailed  discussion  of  the  three  Interest  operators 
available  for  processing  is  given  in  Chapter  III. 

Interesting  Point  Storage.  After  interesting  point  processing  is 
complete,  if  the  user  has  specified  interesting  point  storage, 
subroutine  IF1FLU  is  called  to  determine  the  logical  unit  number  and 
file  name  of  the  file  to  be  used  to  store  the  interesting  point 
information.  The  collection  of  information  stored  on  the  output  file 
is  called  an  Interesting  point  set.  As  in  the  case  of  the  image  file, 
subroutine  IF1FLU  calls  subroutines  LUNBRl  and  FILNM1  to  allow  the  user 
to  interactively  enter  the  logical  unit  number  and  file  name  of  the 
file  to  be  used  to  store  the  interesting  point  set.  Similarly, 
subroutines  IF1CHK  and  IFICOR  are  used  for  error  checking  and 
correction  respectively,  if  needed.  The  flow  diagram  of  this  file 
description  method  is  identical  to  the  one  shown  in  Figure  8. 


All  che  Information  necessary  to  define  the  Interesting  point  set 
Is  assimilated  and  output  to  the  storage  file  by  subroutine  IPSOUT. 
This  subroutine  creates  the  interesting  point  set  file  using  the 
logical  unit  number  and  file  name  previously  defined  In  IF1FLU.  This 
file  is  opened  using  subroutine  0PNIF1  which  opens  a  formatted, 
sequential  file  using  the  assigned  file  name.  Next,  the  logical 
records  containing  the  interesting  point  set  information  are  output  to 
the  file.  Finally,  the  interesting  point  set  file  is  closed  using  the 
DISPOSE  ■  'KEEP'  option  to  save  it.  The  correlation  window  scratch 
file  previously  defined  is  closed  using  the  'DELETE'  option  since  it  is 
no  longer  needed. 

Each  interesting  point  set  consists  of  two  parts:  (1)  a  header 
record  containing  information  about  the  set  of  interesting  points;  and 
(2)  the  interesting  points  and  their  associated  correlation  windows, 
stored  sequentially  in  the  same  order  as  they  are  selected.  The  header 
record  contains  five  fields:  (1)  the  number  of  interesting  points  in 
the  set;  (2)  the  number  of  the  interest  operator  used  to  select  the 
interesting  points;  (3)  the  correlation  window  row  size;  (4)  the 
correlation  window  column  size;  and  (5)  the  total  correlation  window 
size  (product  of  rows  and  columns).  Each  subsequent  record  contains 
four  items  of  information.  The  first  three  items  are  the  first  three 
record  fields  which  contain  the  following:  (l)  the  image  row  location 
of  the  interesting  point;  (2)  the  image  column  location  of  the 
Interesting  point;  and  (3)  the  value  of  the  interesting  point.  The 
last  item  in  the  record  is  the  correlation  window  associated  with  the 


Interesting  point  stored  in  a  single  row  (i.e.,  each  row  of  the  window 
placed  end -to -end) .  This  window  can  be  reconstructed  using  the  values 
of  the  window  row  and  column  sizes  when  the  interesting  point  set  is 
input  for  matching.  The  structure  of  the  interesting  point  set  file  is 
shown  in  Table  II. 

Since  the  maximum  number  of  interesting  points  which  may  be 
selected  is  M  (explained  later),  the  maximum  number  of  records  in  the 
file  is  M  +  1.  Also,  since  the  maximum  size  of  each  correlation  window 
is  restricted  to  M/3,  the  maximum  number  of  record  fields  in  the  file 
is  M/3  +  3.  The  interest  operator  number,  the  number  of  correlation 
window  rows  and  columns,  and  the  correlation  window  size  are  stored  in 
the  variables  IOPNBR,  CWDROW,  CWDCOL,  and  CWDSZE  respectively  as 
previously  explained.  The  remaining  variables  to  be  output  to  the 
interesting  point  set  file  are  stored  within  program  DIDA  in  the  area 
COMMON  /IPS/ .  The  number  of  Interesting  points  is  stored  in  the 
variable  IPKNT.  The  image  row  and  column  location,  and  value  of  the 
interesting  points,  are  stored  in  arrays  IPR(M),  IPC(M),  and  VALUIP(M) 
respectively.  Another  array,  IPCWND(M/3)  (also  called  IPWND),  is  used 
as  a  buffer  array  for  storing  and  retrieving  the  values  of  a  single 
correlation  window  in  the  correlation  window  scratch  file. 

Therefore,  to  store  the  interesting  point  set,  subroutine  IPSOUT 
opens  the  interesting  point  set  file  and  writes  the  header  record.  The 
second  and  subsequent  records  are  then  interactively  formed  by  first 
reading  an  Interesting  point  correlation  window  from  the  correlation 
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Table  II.  Interesting  Point  Set  File  Structure 


IP(M)  ROW  I P ( M)  COL  IP(M)  VALUE  IP(M)  COR  IP(M)  COR  ....  IP(M)  COR 

LOCATION  LOCATION  WINDOW  (1)  WINDOW  (2)  WINDOW  (M/ 3) 


m 


window  file  and  placing  it  in  the  correlation  window  array  buffer 
IPCWND.  The  interesting  point  row  location,  column  location,  and  value 
associated  with  each  successive  iteration  number  (up  to  maximum  of  M) 
are  then  combined  with  the  corresponding  correlation  window  located  in 
the  array  buffer,  and  written  to  the  interesting  point  set  file.  The 
number  of  iterations  is  determined  by  the  value  of  IPKNT.  After  the 
last  record  is  written,  the  interesting  point  set  file  is  closed,  and 
the  correlation  window  scratch  file  is  deleted.  A  flow  diagram 
illustrating  the  method  of  interesting  point  set  storage  is  shown  in 
Figure  14. 

Interesting  Point  Listing.  After  the  interesting  points  have  been 
selected  and  stored  (if  storage  is  requested),  the  user  is  asked  if  a 
listing  of  the  selected  interesting  points  is  desired  (on  the  line 
printer).  If  an  affirmative  response  is  given,  the  row  and  column 
location  of  the  interesting  points,  and  their  corresponding  values,  are 
listed  sequentially  in  the  order  selected.  If  a  negative  response  is 
given,  no  listing  is  obtained. 

In  summary,  to  select  interesting  points  the  image  and  processing 
window  sizes  are  defined  first.  Next,  the  image  intensity  buffer  and 
input  buffer  are  initialized  with  image  data.  After  this,  the  user  is 
asked  if  Interesting  point  storage  is  desired.  If  the  answer  is  yes, 
the  correlation  window  size  is  defined,  the  correlation  window  file  is 
opened,  the  Interesting  points  are  selected  using  the  desired  interest 
operator,  and  the  interesting  point  set  is  stored.  If  storage  is  not 
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Figure  14.  Interesting  Point  Set  Storage 


Flow  Diagram 


desired,  only  the  Interesting  point  selection  operation  is  performed. 
Finally,  the  user  is  asked  if  a  listing  of  the  interesting  points  is 


desired.  If  the  answer  is  yes,  the  points  are  listed;  otherwise,  they 
are  not.  A  flow  diagram  illustrating  the  DIDA  interesting  point 
selection  section  is  shown  in  Figure  15. 

Interesting  Point  Matching  Section 

The  subroutine  source  listings  for  the  interesting  point  matching 
section  of  program  DIDA  are  shown  in  Appendix  E.  This  section  is 
controlled  by  subroutine  IPMTCH.  This  subroutine  first  inputs  two 
interesting  point  sets  for  matching.  After  this,  the  user  selects  the 
matching  algorithm  desired,  and  the  matching  process  begins.  When 
matching  is  complete,  the  points  from  each  of  the  two  interesting  point 
sets  chat  matched,  along  with  some  pertinent  match  statistics,  are 
listed  on  the  line  printer. 

To  attempt  to  match  the  interesting  points  selected  in  a  certain 
image  to  those  in  another  image,  two  sets  of  interesting  points  must  be 
created  and  stored  on  a  file  as  discussed  in  the  previous  section.  It 
is  assumed  that  these  two  images  are  time -dependent,  and  that  objects 
within  the  image  may  be  moving  with  respect  to  one  another  and  the 
stationary  background.  Points  in  the  first  image  should  be  matched 
with  those  in  the  second  image  if  and  only  if  they  are  image  plane 
projections  of  the  same  real-world  surface  point  [Ref.  4:334). 

To  determine  if  two  points  match,  Che  matching  algorithm  must  make 
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Figure  15.  DIDA  Interesting  Point  Selection  Section  Flow  Diagram 
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some  determination  as  to  their  similarity.  If  they  are  highly  similar, 
then  they  may  be  assumed  to  be  matched.  However,  if  several  points  in 
close  proximity  to  one  another  are  all  similar,  it  becomes  more 
difficult  to  determine  the  two  which  exactly  match.  For  this  reason, 
all  of  the  interesting  points  which  should  be  matched  may  not  be 
matched.  Also,  false  matches  may  occur.  For  purposes  of  this  effort, 
the  matching  efficiency  of  the  matching  algorithm  is  defined  as  the 
ratio  of  matched  to  unmatched  points  expressed  as  a  percentage. 

As  an  illustration,  consider  the  moving  object  shown  in  Figure  16. 
Assume  that  interesting  points  were  located  at  each  of  its  corners  in 
image  i,  and  also  in  image  i  +  1.  If  the  matching  algorithm  determines 
that  the  points  in  the  lower-left  hand  corner  and  upper  right-hand 
corner  are  matched,  then  two  of  the  four  points  have  been  matched.  In 
this  case,  the  matching  algorithm  has  a  matching  efficiency  of  50%. 

In  the  following  sub-sections,  each  of  the  major  operations 
associated  with  the  interesting  point  matching  section  is  discussed. 
As  mentioned  in  the  sequence  of  presentation  section  of  the 
introduction,  the  matching  algorithm  is  only  generally  described  in 
this  section.  This  algorithm  is  discussed  in  detail  in  Chapter  IV. 

Interesting  Point  Set  Input.  Subroutine  IPMTCH  first  calls 
subroutine  IPSOPN  to  open  the  files  associated  with  the  interesting 
point  sets  to  be  input.  To  begin  with,  IPSOPN  calls  subroutine  IF1FLU 
to  allow  the  user  to  interactively  determine  the  logical  unit  number 
and  file  name  of  the  first  set  of  interesting  points  to  be  input  for 
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matching.  This  Is  the  same  subroutine  used  to  define  the  logical  unit 
number  and  file  name  for  storing  the  Interesting  point  set  as  described 
In  the  Interesting  point  storage  sub-section  above.  Similarly, 
subroutine  0PNIF1  Is  called  to  open  the  file.  After  the  file  Is  open, 
the  header  record  of  the  first  Interesting  point  set  Is  read  and  stored 
In  the  area  COMMON  /IPS1/.  The  Information  shown  In  record  1  of  Table 
II  Is  stored  In  the  variables  IPKNT1,  IPTYP1,  CWR0W1,  CWC0L1 ,  and 
CWSZE1  respectively.  The  Interesting  points  and  associated  correlation 
windows  from  Interesting  point  set  1  are  now  ready  to  be  input. 

Subroutine  IPSOPN  next  calls  subroutine  IF2FLU.  The  operation  of 
this  subroutine  Is  identical  to  subroutine  IF1FLU.  Similarly, 
subroutines  LUNBR2,  FILNM2,  IF2CHK,  and  IF2C0R  perform  the  same 
functions  as  before  (see  Figure  8).  The  file  information  for  this  file 
is  stored  In  the  area  COMMON  /IFILE2/  In  the  variables  LUN2,  NCHAR2, 
and  FNAME2 .  Subroutine  0PNIF2  Is  then  called  to  open  the  file,  and 
performs  the  same  function  as  subroutine  0PNIF1.  After  this  second 
file  is  open,  the  header  record  of  the  second  Interesting  point  set  Is 
read  and  stored  In  the  area  COMMON  /IPS2/.  The  information  shown  In 
record  1  of  Table  II  Is  stored  in  the  variables  IPKNT2,  IPTYP2,  CWR0W2 , 
CWC0L2,  and  CWSZE2  respectively.  The  Interesting  points  and  associated 
correlation  windows  from  Interesting  point  set  2  are  now  ready  to  be 
input. 


After  the  header  record  of  both  Interesting  point  sets  has  been 
Input,  a  comparison  of  the  information  contained  In  each  is  displayed 
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Figure  16.  Interesting  Point  Matching  Illustration 


co  Che  user.  Table  III  llluscraces  che  information  displayed  by 
subroucine  IPSOPN.  This  informaclon  Is  displayed  Co  allow  che  user  Co 
visually  check  che  percinenc  Informaclon  of  each  inceresclng  polnc  sec 
before  matching  begins  in  case  chis  information  has  been  forgotten  or 
lose.  The  user  is  next  asked  if  Che  matching  process  is  Co  be 
continued.  If  an  affirmative  response  is  given,  matching  continues. 
If  a  negative  response  is  given,  both  of  the  interesting  point  set 
files  are  closed,  and  program  DIDA  terminates  execution.  Notice  that 
it  is  not  necessary  for  any  of  the  correlation  window  information  to  be 
the  same  to  perform  matching.  Program  DIDA  automatically  compensates 
for  correlation  windows  of  different  sizes  by  finding  the  region  of 
common  overlap  of  the  two  windows  and  then  defining  new  correlation 
windows  of  equivalent  sizes  containing  only  the  elements  common  to  both 
original  windows  (this  is  described  in  more  detail  in  Section  IV).  A 
flow  diagram  illustrating  the  method  of  interesting  point  set  input  is 
shown  in  Figure  17. 

Interesting  Point  Matching.  If  the  user  desires  to  continue  the 
matching  process  after  visually  comparing  the  two  interesting  point 
sets,  subroutine  IPMTCH  calls  subroutine  MTASEL.  This  subroutine 
allows  the  user  to  interactively  select  the  matching  algorithm  to  be 
used  to  match  the  interesting  points  of  the  two  sets.  Presently,  only 
one  matching  algorithm  exists  (subroutine  MTALGl).  Subroutines  MTALG2, 
MTALG3,  MTALG4 ,  and  MTALG5  are  not  used.  The  user  may  also  terminate 
matching  or  program  execution,  if  desired. 
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Table  III.  Subroutine  IPSOPN  Information  Display 


Figure  17.  Interesting  Point  Set  Input  Flow  Diagram 
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If  Che  user  enters  a  response  of  1  when  querrled  by  subroutine 
MTASEL  for  the  desired  matching  algorithm,  subroutine  MTALGL  is  called. 
This  subroutine  begins  by  describing  a  disparity  window  size  to  be  used 
to  form  labels  from  Interesting  points  from  each  set  which  are  in  close 
proximity  of  each  other.  After  this,  the  orientation  of  the 
correlation  windows  surrounding  each  interesting  point  in  each  is 
determined.  A  weighting  algorithm  is  then  selected  to  determine  the 
correlation  of  the  two  windows  for  each  set  of  interesting  points. 
From  this  correlation,  a  weight  is  determined.  This  weight  is  used  to 
form  an  initial  probability  for  the  label  associated  with  the  two 
interesting  points  being  compared. 

Labels  are  formed  for  points  in  each  set  which  are  close  to  each 
other  by  talcing  the  difference  between  the  row  and  column  coordinate 
values  of  each  set  of  points.  In  other  words,  each  interesting  point 
in  set  l  (now  called  a  node)  is  compared  with  all  the  interesting 
points  in  sec  2.  For  all  points  of  set  2  within  the  disparity  window 
surrounding  each  node,  labels  are  formed  by  their  coordinate 
differences.  Probabilities  are  then  assigned  to  these  labels  using  the 
weights  computed  by  the  comparison  of  their  correlation  windows.  These 
labels  are  really  the  disparity  vectors  associated  with  each  node. 

Once  all  the  labels  for  all  the  nodes  have  been  formed,  the  labels 
of  one  node  are  compared  with  the  labels  of  other  nodes  within  a  small 
neighborhood  surrounding  the  node  to  update  the  initial  probabilities 
assigned  to  each  label.  In  other  words,  each  node  is  now  compared  with 


all  Che  ocher  nodes  formed  by  Che  flrsC  InCeresClng  poinc  sec.  For  all 
nodes  within  a  given  neighborhood  of  Che  node  being  Cesced  (excluding 
Che  CesC  node  Itself),  Che  labels  of  each  node  are  compared  wlch  Che 
labels  of  Che  CesC  node  one-by-one.  If  Che  dlsparlcy  veccors  of  the 
two  labels  being  compared  are  similar,  Che  maCch  probablllcy  of  Che 
label  of  Che  CesC  node  Is  Increased.  If  they  are  dissimilar,  Che 
no-match  probablllcy  Is  Increased. 

After  several  Iterations  (10  are  used  for  this  study),  the 
probablllcy  updaCes  are  assumed  Co  have  reached  a  steady  state.  The 
probabilities  of  all  the  labels  associated  with  each  node  are  then 
checked.  If  the  probability  of  one  of  the  labels  Is  above  0.7,  that 
node  Is  said  to  be  matched.  The  point  to  which  It  Is  matched  In  Image 
2  Is  then  determined  by  adding  the  disparity  vector  of  the  label  with 
probability  above  0.7  to  the  coordinates  of  the  node.  This  determines 
the  coordinates  of  the  point  In  Image  2  to  which  the  node  Is  matched. 
Thus,  the  position  to  which  the  node  moves  from  Image  1  to  Image  2  has 
been  determined.  This,  in  general,  is  the  essence  of  disparity 
analysis.  This  matching  process  is  described  In  greater  detail  in 
Chapter  IV. 

Hatched  Points  Listing.  After  the  Interesting  points  from  set  1 
have  been  matched  to  those  In  set  2,  the  points  which  successfully 
match  are  listed  on  the  line  printer.  The  node  which  has  been  matched 
and  Its  new  location  in  Image  2  are  both  listed.  To  accomplish  this 
listing,  subroutine  IPMTCH  calls  subroutine  MPLST.  Subroutine  MPLST 


also  prints  out  match  statistics  concerning  the  results  of  the  matching 
process.  These  statistics  include:  (1)  the  number  of  interesting 
points  in  image  1;  (2)  the  number  of  interesting  points  in  image  2;  (3) 
the  number  of  matched  points; (4)  the  number  of  unmatched  points;  and  (5) 
the  percentage  matched  (the  matching  efficiency). 

In  summary,  to  match  interesting  points,  the  files  containing  the 
two  sets  of  interesting  points  to  be  matched  are  opened  and  compared. 
If  favorable  match  conditions  exist,  the  matching  algorithm  is  selected 
and  matching  begins.  Labels  are  formed  from  the  disparity  between 
points  in  each  set  which  are  close  to  each  other.  Probabilities  are 
assigned  to  these  labels  based  on  the  comparison  of  the  correlation 
windows  of  each  interesting  point  used  to  form  the  label.  These 
probabilities  are  updated  by  comparing  the  labels  of  nodes  within  a 
given  neighborhood.  When  these  probability  updates  reach  steady  state, 
they  are  checked  to  determine  if  a  match  has  occured.  If  so,  it  is 
listed  on  the  line  printer  along  with  other  vital  match  statistics.  A 
flow  diagram  illustrating  the  DIDA  interesting  point  matching  section 
is  shown  in  Figure  18. 

Image  Display  Section 

The  subroutine  source  listings  for  the  image  display  section  of 
program  DIDA  are  shown  in  Appendix  F.  This  section  is  controlled  by 
subroutine  IMGDSP.  As  in  the  image  operations  and  interesting  point 
selection  sections,  the  image  size  is  defined  first.  Next,  the  logical 
unit  number  and  file  name  of  the  image  to  be  displayed  are 
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Figure  18.  DIDA  Interesting  Point  Matching  Section  Flow  Diagram 


interactively  defined,  and  the  image  file  is  opened.  After  this,  the 


user  is  asked  what  type  of  display  is  desired.  When  the  type  of 
display  is  selected,  this  display  is  sent  to  a  cathode  ray  tube  (CRT) 
by  the  RAMTEK  driver. 

To  define  the  image  size,  subroutine  IMGDSP  calls  subroutine 
IMGSZE.  Subroutines  FLUFND  and  OPNOLD  are  then  called  to  allow  the 
user  to  enter  the  logical  unit  number  and  file  name  of  the  image  to  be 
displayed,  and  open  it.  The  description  of  the  operation  of  these 
subroutines  was  given  in  previous  sections  and  will  not  be  repeated 
here  (refer  to  Figures  6  and  8). 

After  the  image  file  is  opened,  and  the  logical  unit  number  of  the 
RAMTEK  driver  has  been  assigned,  subroutine  IMGDSP  calls  subroutine 
DSPSEL  to  allow  the  user  to  select  the  desired  image  display  operation. 
Four  image  display  options  are  available:  (I)  display  a  black  and 
white  (B/W)  image;  (2)  display  a  color  image;  (3)  display  interesting 
points  on  a  black  and  white  image;  and  (4)  display  interesting  points 
on  a  color  image.  The  user  may  also  terminate  image  display  operations 
or  program  execution,  if  desired. 

B/W  Display.  To  display  a  black  and  white  image,  the  user  enters 
the  number  1  when  querried  by  subroutine  DSPSEL  concerning  the  desired 
display  option.  This  entry  causes  the  variable  ICOLOR  to  be  set  to 
zero,  and  subroutine  RAMST  to  be  called.  Subroutine  RAMST  initially 
clears  the  video  screen  (the  CRT),  and  defines  the  values  of  the  video 
look-up  table  for  a  black  and  white  image  display.  The  parameters 
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IPAR,  IOSTAT,  IVLT,  and  IMBUF  are  set  to  their  corresponding  initial 
values;  and  the  initialization  parameters  are  sent  to  the  RAMTEK  via 
the  system  subroutine  call  to  subroutine  WTQIO.  A  specific  description 
of  the  operational  features  of  the  RAMTEK  driver  are  beyond  the  scope 
of  this  thesis,  and  will  not  be  discussed  further. 

After  the  call  to  RAMST  to  initialize  the  system,  subroutine 
IMDSP1  is  called  to  display  the  B/W  image.  This  subroutine  first  asks 
the  user  if  a  blow-up  of  the  desired  image  from  its  present  size  to  a 
size  of  512x512  is  desired.  If  an  affirmative  response  is  offered,  the 
image  is  blown -up  from  its  present  size  to  a  size  of  512x512  using  the 
blow-up  feature  of  the  RAMTEK.  In  this  case,  the  scaling  parameter 
ISCALE  is  set  to  zero  to  signal  that  blow-up  of  the  image  is  desired. 
If  image  scaling  (i.e.,  blow-up)  is  not  desired,  ISCALE  is  set  to  1. 

When  scaling  has  been  selected,  subroutine  IMDSP1  inputs  the  image 
to  be  displayed  one  row  at  a  time  by  calling  subroutine  INPUT.  The 
input  byte  intensity  values  are  then  transferred  to  the  integer  word 
intensity  buffer  by  performing  byte-to-word  number  conversion  (see 
Appendix  G).  These  rows  of  intensity  data  are  then  sent  to  the  RAMTEK 
driver  by  calling  subroutine  RAMWT.  After  the  image  has  been 
displayed,  the  image  file  is  closed  by  calling  subroutine  CLOSKP. 

Subroutine  RAMWT  first  checks  the  value  of  ISCALE  to  see  if 
scaling  is  desired.  If  it  is,  the  image  pixels  displayed  by  the  RAMTEK 
are  expanded  by  the  appropriate  scale  factor.  Next,  the  RAMTEK 
instruction  set  is  established  based  on  the  scaling  parameters 


69 


specified.  The  image  data  is  then  sent  to  the  RAMTEK  driver  via 
subroutine  WTQIO,  and  a  B/W  image  is  displayed. 


Color  Display.  To  display  a  color  image,  the  user  enters  the 
number  2  when  querried  by  subroutine  DSPSEL  concerning  the  desired 
display  option.  This  entry  causes  the  variable  ICOLOR  to  be  set  to  1, 
and  subroutine  RAMST  to  be  called.  Again,  subroutine  RAMST  initially 
clears  the  video  screen,  but  this  time  the  video  look-nip  table  is 
defined  for  a  color  rather  than  a  B/W  image.  From  this  point  on,  the 
image  display  sequence  is  Identical  to  that  for  the  B/W  display.  The 
change  in  the  sub-channels  of  the  video  look-up  table  produces  the 
color  display. 

B/W  Interesting  Points  Display.  To  display  a  B/W  image  with  a  set 
of  interesting  points  superimposed  on  it,  the  user  enters  the  number  3 
when  querried  by  subroutine  DSPSEL  concerning  the  desired  display 
option.  This  entry  causes  the  variable  ICOLOR  to  be  set  to  zero,  and 
subroutine  RAMST  to  be  called,  as  explained  above.  Next,  subroutine 
IMDSP2  is  called  to  display  the  interesting  points  on  the  B/W  image. 

Subroutine  IMDSP2  first  calls  subroutine  IMDSPl  to  display  the 
desired  B/W  image,  as  explained  above.  After  this,  the  user  Is  asked 
to  enter  the  logical  unit  number  and  file  name  of  the  set  of 
interesting  points  to  be  written  over  the  displayed  image.  Subroutine 
IFIFLO  is  then  called  to  allow  the  user  to  interactively  input  this 
information,  and  the  Interesting  point  set  file  is  opened  by  calling 
subroutine  0PNIF1.  Next,  the  number  of  interesting  points  in  the  set 
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is  read,  and  the  interesting  points  are  read  in  from  the  file  and 
stored  in  arrays  IPR(H)  and  IPC(M)  in  the  area  COMMON  /IPS/. 
Subroutine  RAMIP  is  then  called  to  write  the  interesting  points  on  the 
displayed  image,  and  the  interesting  point  set  file  is  closed. 

Subroutine  RAMIP  sets  up  the  RAMTEK  instruction  set  by  modifying 
the  row  and  column  location  of  the  already  displayed  image  at  each 
location  where  an  interesting  point  is  to  be  displayed.  A  3x3  square 
of  a  contrasting  intensity  is  written  about  the  point  on  the  CRT  where 
the  interesting  point  exists.  To  accomplish  this,  yellow  squares  are 
written  on  a  B/W  image  (the  case  here)  and  black  squares  are  written  on 
a  color  image.  Again,  after  the  instruction  set  has  been  set  up, 
subroutine  WTQIO  is  called  to  send  the  data  to  the  RAMTEK  driver. 

Color  Interesting  Points  Display.  To  display  a  color  image  with  a 
set  of  interesting  points  superimposed  on  it,  the  user  enters  the 
number  4  when  querried  by  subroutine  DSPSEL  concerning  the  desired 
display  option.  This  entry  causes  the  variable  ICOLOR  to  be  set  to  1, 
and  subroutine  RAMST  to  be  called,  as  explained  above.  Next, 
subroutine  IMDSP2  is  called  to  display  the  interesting  points  on  the 
color  image.  From  this  point  on,  the  image  display  sequence  is 
identical  to  that  for  the  B/W  interesting  points  display.  A  flow 
diagram  illustrating  the  image  display  section  of  program  DIDA  is  shown 
in  Figure  19. 

Image  Data  Bases 


Figure  19.  DIDA  Image  Display  Section  Flow  Diagram 
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To  accomplish  the  image  operations,  interesting  point  selection, 
interesting  point  matching,  and  image  display  as  discussed  in  the 
previous  sections,  one  common  ingredient  is  needed  -  an  image!  To 
obtain  images  for  processing,  three  data  bases  were  created  on  disk 
files  from  data  tapes  secured  from  three  Independent  sources.  These 
data  tapes  contain  digitized  image  data  from  real-world  (or  simulated 
real-world)  scenes  as  discussed  in  the  image  size  subsection  of  the 
image  operations  section  above  (also  see  FigureS).  A  description  of 
each  of  these  data  bases,  along  with  a  brief  discussion  concerning  the 
method  used  to  transfer  them  from  tape  to  disk,  is  given  in  the 
following  subsections. 

NVL  Data  Base.  The  first  data  base  to  be  discussed  is  a  series  of 
20  noise-corrupted  images  received  from  the  Lockheed  Palo  Alto  Research 
Laboratory  [Ref.  9].  This  imagery  was  created  as  part  of  the  DARPA 
Image  Understanding  Program  under  the  direction  of  Lt.  Col.  L.  E. 
Druffel,  USAF,  and  monitored  by  Dr.  Tamburino.  The  imagery  was 
digitized  from  a  simulated  flight  over  the  terrain  board  of  the  U.S. 
Army  Night  Vision  Laboratory  (NVL),  heading  due  north  over  villages 
east  of  the  river.  Data  defects  include  banding,  graininess,  and  poor 
focus. 


The  images  were  received  on  a  9 -track  magnetic  tape,  L600 
bits/inch  (bpi),  phase  encoded,  odd  parity.  Size  of  each  image  is 
512x512  pixels.  Each  image  file  on  the  tape  contains  129  physical 
records.  The  first  record  is  the  header,  and  records  2  -  129  contain 


73 


Che  image  data 


Each  physical  record  contains  2052  16-bit  words  as  described 
below: 


WORDS  IMAGE  ROW 


Description  of  record  n 
(2l  n  1129) 


1  -  512 

4n  -  7 

513  -  1024 

4n  -  6 

1025  -  1536 

4n  -  5 

1537  -  2048 

4n  -  4 

2049  -  2052 

UNUSED 

Thus,  each  physical  record  contains  four  image  rows.  For  example, 
for  record  20  (n  **  20),  the  image  rows  contained  are  4(20)  -  7  *  73, 
4(20)  -  6  =  74,  4(20)  -  5  *  75,  and  4(20)  -  4  *  76.  Each  intensity 
within  each  record  is  stored  as  a  16-bit  word  represented  by  two  8-bit 
bytes  to  produce  a  range  of  intensities  from  0  to  511  as  shown  below: 


word  i 


8-bit  high-order  byte 
8-bit  low-order  byte 


As  mentioned  previously,  an  8 -bit  byte  is  required  to  represent 
the  range  of  numbers  from  0  to  255.  To  represent  the  range  from  0-511, 
only  one  more  bit  is  required.  Thus,  the  high  order  byte  for  each  word 
is  only  l  or  0.  It  will  be  a  1  if  the  intensity  value  is  greater 
than  255  (also  see  Appendix  G). 
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In  order  to  transfer  this  data  base  to  a  disk  file  and  make  it 
compatible  with  the  input  requirements  of  program  DIDA,  a  data 
conversion  program  was  written.  This  program  is  a  modification  of  the 
standard  tape -to -disk  conversion  program,  and  is  shown  in  Appendix 
H.  To  convert  the  data,  it  was  necessary  to  write  it  to  the  disk  files 
as  a  direct  access,  unformatted,  sequential  file  in  the  range  of  0  to 
255.  Thus,  data  scaling  was  required. 

To  scale  the  data,  the  low-order  byte  is  tested  for  a  negative 
number.  If  negative,  it  is  divided  by  two  (to  scale  it)  and  the  sign 
bit  is  changed  (see  Appendix  G).  If  non-negative,  the  number  is  merely 
divided  by  two.  Next,  the  high -order  byte  is  tested.  If  it  is  equal 
to  l,  this  1  is  shifted  into  the  MSB  position  of  the  low-order  byte  to 
preserve  the  range  integrity.  If  the  high-order  byte  is  zero,  no  other 
operation  is  performed. 

After  this  number  conversion  and  scaling  is  accomplished,  the 
high-order  bytes  are  stripped  away  from  the  low-order  bytes  (which  now 
contain  the  correct  converted  scaled  intensity  values  in  the  range 
0-255)  and  output  to  the  disk  file.  Nine  of  the  20  image  files  were 
written  to  the  disk  before  its  storage  capacity  was  exceeded.  A 
listing  of  the  disk  files,  and  other  pertinent  information,  is  shown  in 
Table  IV. 

UM  Data  Base.  The  second  data  base  to  be  discussed  is  a  sequence 
of  18  frames  (images)  of  various  objects  received  from  Dr.  William 

B.  Thompson  of  the  University  of  Minnesota,  Computer  Science 
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Department,  Minneapolis,  MN.  The  tape  received  contains  a  collection 
of  image  pairs  and  sequences  from  their  local  library.  Five  groups  of 
images  were  received. 

The  images  received  were  recorded  on  a  9 -track  tape  at  a  density 
of  1600  bpi.  Each  image  is  contained  in  a  separate  file.  One  tape 
record  exists  for  each  image  row,  and  each  record  field  corresponds  to 
a  single  8-bit  gray  scale  intensity  value  in  the  range  from  0  to  255. 
Thus,  unlike  the  NVL  data,  this  data  base  was  received  in  a  format 
already  compatible  with  the  input  format  of  program  DIDA. 

All  that  was  necessary  to  transfer  this  data  base  to  disk  was  to 
use  the  standard  tape-to-disk  transfer  program  to  read  the  data  from 
the  tape  and  transfer  it  to  a  direct  access,  unformatted,  sequential 
file  on  the  disk.  This  transfer  program  is  similar  to  the  one  shown  in 
Appendix  H,  so  it  is  not  shown  to  conserve  space. 

As  mentioned  above,  the  images  on  the  tape  were  contained  in  five 
groups : 

(1)  A  truck  which  moves  against  a  stationary  background. 

(2)  A  simulated  fly-over  of  downtown  Minneapolis. 

(3)  A  stereo  pair  of  pictures  which  include  a  person  sitting  in  a 
chair. 


(4)  An  8-frame  sequence  of  childrens  toys.  Two  of  the  toys  move 
in  opposite  directions.  In  the  later  frames,  one  of  the  toys  partially 
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occludes  the  other 


(5)  A  4-frame  sequence  of  a  room  taken  with  a  side-looking  moving 
camera. 

All  images  were  123x128  pixels.  A  listing  of  the  disk  files,  and 
other  pertinent  information,  is  shown  in  Table  IV. 

UH  Data  Base.  The  final  data  base  to  be  discussed  is  a  33  frame 
sequence  of  images  received  on  tape  from  Dr.  Wesley  E.  Snyder  of  the 
Computer  Science  Department  of  North  Carolina  State  University, 
Raleigh,  NC.  This  tape  was  obtained  by  Dr.  Snyder  from  professor  Hans 
Nagel  of  the  University  of  Hamburg,  Hamburg,  Germany.  Each  tape  image 
contains  512  records  of  one  image  row  per  record.  Each  record  contains 
512  8 -bit  data  intensity  values  in  the  range  from  0  to  255.  Thus, 
like  the  UM  data  base,  this  data  base  was  received  in  a  format  already 
compatible  with  the  input  format  of  program  DIDA. 

Transfer  of  this  data  base  from  tape-to-disk  was  quite  simple. 
The  tape  was  created  on  a  DEC  VAX  machine  using  the  "copy"  command.  As 
it  turns  out,  the  copy  command  of  the  DEC  PDF  11/45  is  compatible  with 
that  of  the  VAX.  Thus,  all  that  was  required  to  copy  to  the  disk  was 
to  use  the  PIP  "COPY"  command  and  the  data  was  transferred. 

The  UH  data  base  consists  of  a  33  frame  sequence  of  a  traffic 
scene.  In  the  sequence,  a  taxi  cab  is  shown  turning  a  corner  at  a  busy 
intersection  in  Hamburg.  Only  eight  frames  were  copied  to  disk  before 
the  disk  storage  space  limit  was  exceeded.  However,  this  was  more  than 
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sufficient  for  purposes  of  this  study.  A  listing  of  the  disk  files, 
and  other  pertinent  information,  is  shown  in  Table  IV. 

In  summary,  three  data  bases  were  created.  The  NVL  data  base 
contains  a  noise-corrupted  set  of  images  taken  from  a  terrain  board 
during  a  simulated  flight.  The  UM  data  contains  various  pairs  of 
images  and  image  sequences  taken  from  a  moving  truck,  a  simulated 
flyover  of  downtown  Minneapolis,  a  person  sitting  in  a  chair, 
children's  toys  moving  relative  to  each  other,  and  a  room  taken  with  a 
moving  side-looking  camera.  Finally,  the  UH  data  base  contains  a 
traffic  scene  showing  a  taxi  cab  turning  left  at  a  busy  intersection 
in  Hamburg. 
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III.  Interesting  Point  Selection  Algorithms 


Computer  analysis  of  time-varying  images,  or  CATVI,  implies  the 
processing  of  a  time-sequence  of  images  in  order  to  extract  some 
property  which  changes  in  time  [Ref.  10:7],  As  an  example  of  this, 
consider  the  moving  tank  mentioned  on  page  1  of  the  introduction 
section.  As  the  tank  moves  from  scene -to -scene  through  the  imaging 
sensors  field -of -view,  it  creates  a  displacement  relative  to  the 
background  (and  sensor)  due  to  its  motion.  Thus,  as  the  sensor 
processes  sequential  images,  the  motion  of  the  tank  creates  a 
difference  in  the  information  content  of  the  images  from  one  frame  to 
the  next.  When  such  differences  occur  between  two  images,  a 
"disparity"  is  said  to  exist  between  them,  which  is  represented  as  a 
vector  field  mapping  one  Image  into  the  other  [Ref.  4:333].  The 
determination  of  disparity  is  often  referred  to  as  the  "correspondence 
problem"  [Ref.  11:399];  or,  more  simply,  "disparity  analysis." 

The  goal  of  disparity  analysis  is  to  assign  disparities  (which  are 
two-dimensional  vectors  for  the  purpose  of  this  study)  to  a  collection 
of  points  in  one  of  the  images.  These  points,  called  "interesting 
points,"  are  located  (selected)  using  an  interesting  point  selection 
algorithm  called  an  "interest  operator."  Once  these  interesting  points 
have  been  selected  on  a  given  image,  they  are  matched  to  their 
corresponding  points  on  a  subsequent  image  using  a  matching  algorithm. 
As  mentioned  in  the  interesting  point  (Batching  section  of  Chapter  II, 
not  all  of  the  interesting  points  selected  will  necessarily  be  matched. 
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Also,  ambiguous  matches  may  occur  (i.e.,  interesting  points  in  one 
image  matched  to  the  wrong  point  in  another  image),  or  points  may  be 
occluded  in  some  images  and  visible  in  others.  To  be  effective,  an 
interest  operator  must  select  interesting  points  which  may  be  easily 
matched  from  image -to -image.  Thus,  interest  operators  must  be 
sensitive  to  local  variances,  edges,  and  other  distinctive  image 
properties  in  order  to  select  potentially  matchable  points.  It  is  also 
advantageous  to  select  points  which  are  easily  distinguishable  from 
their  neighbors. 

Selection  of  interest  operators  varies  widely.  Hannah  suggests 
interest  operators  with  variances  such  that  the  interesting  points 
selected  are  defined  to  be  local  maxima  within  the  region  of  interest 
[Ref.  12:202-203].  Barnard  and  Thompson  describe  a  sum -of -squares 
differencing  in  four  directions  over  the  processing  window  area  [Ref. 
4:335].  This  is  the  technique  first  defined  by  Moravec  [Ref.  L3:  584], 
and  has  become  known  as  the  "Moravec  Operator."  Gennery  also  uses  this 
Moravec  Operator  in  a  3tereo  vision  system  for  an  autonomous  vehicle 
[Ref.  14:  576].  Various  other  interest  operators  are  described  more 
generally  in  a  survey  article  by  Martin  and  Aggarwal  [Ref.  15]. 

In  the  sections  to  follow,  the  three  interest  operators  used  in 
this  study  are  discussed  in  detail.  These  three  operators  are:  (1) 
simple  variance;  (2)  directed  variance;  and  (3)  edged  variance.  The 
second  operator  is  the  Moravec  Operator.  These  three  operators  are 
summarized  by  Hannah  [Ref.  9:  (3-2)-(3-5)] .  A  description  of  the 
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Implementation  In  program  DIDA  Is  given  along  with  the  discussion  of 
each  Interest  operator. 


Simple  Variance  Interest  Operator 

As  mentioned  above,  Interesting  points  are  selected  based  on  some 
''Interesting"  feature  of  various  portions  of  the  Image.  As  the 
processing  window  of  size  WNDROW  X  WNDCOL  shown  in  Figure  10  is  moved 
across  the  image  as  shown  In  Figure  12,  the  area  of  the  image  enclosed 
by  the  window  Is  searched  for  an  Interesting  feature  which  may  be  used 
to  define  an  interesting  point.  One  method  of  defining  an  interesting 
point  is  to  use  the  statistical  variance  (refered  to  as  "simple" 
variance)  over  the  window  as  an  interest  operator.  If  the  3iraple 
variance  of  a  given  window  position  exceeds  a  specific  user-defined 
threshold,  the  center  of  that  window  position  is  defined  to  be  an 
interesting  point. 


Consider  an  n  X  m  dimensional  array  of  numbers  called  A.  Each 
element  of  array  A  is  located  by  its  row  and  column  location  i  and  j, 
respectively,  and  is  referred  to  as  a^.  The  simple  variance  is  the 
average  of  the  square  of  the  deviations  of  A  about  their  mean  [Ref.  16: 
7].  The  mean,  M,  is  defined  as 


M 


1  ,  n  m 

— —  {  Z  Z 

nm  i=l  j=l 


3ij} 


(1) 


The  variance,  V,  is  given  by 


■■a**  - 
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V  =  — —  {  Z  Z  (a  .  -  M)  } 
nm  i=l  j=l  ij 


Or,  more  simply  as  [Ref.  16:  13] 
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Thus,  Co  compute  the  variance,  the  mean  is  first  computed  by 
summing  up  all  the  elements  of  A,  then  dividing  by  the  total  number  of 
elements.  The  variance  is  then  calculated  by  summing  up  all  the 
squares  of  the  elements  of  A,  dividing  this  sum  by  the  total  number  of 
elements,  and  subtracting  the  square  of  the  mean  from  the  result. 

In  program  DIDA,  to  select  interesting  points  using  the  simple 
variance  operator,  the  user  enters  a  1  when  querried  concerning  the 
desired  interest  operator  in  subroutine  IOPSEL,  as  explained  in  the 
interesting  point  selection  section  of  Chapter  II  above.  This  entry 
causes  IOPSEL  to  call  subroutine  IOPl  which  computes  the  variance  of 
each  window  position,  and  then  determines  if  an  interesting  point 
exists.  If  an  interesting  point  is  found  Co  exist  at  a  certain  window 
location,  it  is  placed  in  arrays  IPR,  IPC,  and  VALUIP  in  the  area 
COMMON  /IPS/.  If  interesting  point  set  storage  has  been  requested,  the 
correlation  window  corresponding  to  the  interesting  point  is  stored  on 


jjisZjL  . 
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a  temporary  scratch  file,  as  previously  explained 


To  begin  with,  subroutine  I0P1  calls  subroutine 
THRHLD  to  allow  the  user  to  specify  the  variance 
threshold  to  be  used  to  test  for  interesting  points. 
Subroutine  THRHLD  also  allows  the  user  to  check  the  threshold  entry 
(specified  by  the  variable  THRESH)  and  to  make  corrections,  if  desired. 
Next,  subroutine  INITAL  is  called  to  initialize  various  parameters 
associated  with  interesting  point  processing.  To  select  the 

interesting  points,  subroutine  SVAR  is  called  which  returns  the  value 

of  simple  variance  for  a  given  window  position.  This  value  of  variance 
(specified  by  the  variable  VARNCE)  is  then  tested  against  the 

user-defined  threshold.  If  the  value  of  VARNCE  is  greater  than  the 
value  of  THRESH,  an  interesting  point  exists  at  that  window  location, 
and  subroutine  IPSTOR  is  called  to  store  the  location  and. value  of  the 
Interesting  point  (and  the  correlation  window,  if  requested).  Finally, 
subroutine  WNDMOV  is  called  to  advance  the  window  to  the  next 

sequential  row  and  column  position  (see  Figure  12).  If  the  last  window 
position  is  detected  by  subroutine  WNDMOV  (Fig.  I2(i)),  interesting 
point  processing  is  complete  and  subroutine  CLOSKP  is  called  to  close 
the  image  file. 

Simple  Variance  Computation.  To  compute  the  variance  at  each 
window  position,  subroutine  SVAR  calls  subroutine  MEANFD  to  compute  the 
mean  as  given  by  equation  (1).  The  sum  of  the  squares  of  the  intensity 
elements  for  each  window  position  is  computed  in  subroutine  MEANFD, 
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along  with  che  suns  of  the  Intensities.  The  sum  of  the  intensities, 
the  sum  of  Che  squares,  and  the  value  of  the  mean  are  stored  in  the 
area  COMMON  /MEAN/  by  the  variables  COLSUM,  SQRSLFM,  and  MEAN 
respectively.  SVAR  computes  the  variance  by  squaring  the  value  of  MEAN 
obtained  in  MEANFD  and  subtracting  the  result  from  the  product  of 
SQRSUM  and  WNDINV  as  given  by  equation  (5). 

To  compute  the  mean  at  each  window  position,  subroutine  MEANFD 
sums  the  values  of  the  intensity  elements  of  the  window  and  multiplies 
the  resultant  sum  by  WNDINV.  To  determine  these  window  sums,  partial 
sums  of  each  window  column  are  first  formed.  These  partial  sums  are 
then  summed  to  form  the  total  window  sum.  From  equation  (1),  let 

Sj  =  iJl  aij  (*) 


then  equation  (l)  can  be  rewritten  as 


M  = 


— — {  E 
nm  j  =  l 


S.} 

J 


(7) 


Upon  closer  inspection,  an  even  further  simplification  is 
observed.  Recall  that  the  window  is  moved  across  the  image  one  column 
at  a  time  horizontally.  Thus,  after  summing  all  the  column  sums  of  the 
window  when  it  is  in  its  leftmost  position  on  the  image,  subsequent 
sums  can  be  formed  by  adding  the  column  sum  to  Che  immediate  right  of 
the  window  to  the  previous  sum,  and  subtracting  the  leftmost  column  sum 
of  the  window.  Thus,  if  Mj  is  the  mean  of  the  window  in  its  leftmost 


85 


MICROCOPY  RESOLUTION  TEST  CHART 

NATIONAL  BUREAU  OF  STANDARDS -1%3-A 


position  on  the  Image,  the  mean  of  the  window  displaced  one  column  to 
the  right,  ,  Is  given  by  (from  equations  (6)  and  (7)) 

M2  -  Mi  +  S  t  -  Si  (8) 

Similarly,  the  sum  of  the  squares  of  the  Intensities  over  the 
window  can  be  represented  by  partial  sums  as 

T.  "A  U  "  1.2,3,... ,«)  (9) 

J  1* 1  1 J 

If  N}  Is  the  sum  of  the  partial  square  sms  of  the  window  In  Its 
leftmost  position  on  the  Image,  the  sum  of  the  squares  of  the  window 
displaced  one  column  to  the  right,  Nj.  is  given  by 

N2  -  »i  +  -  Ti  (10) 

Now  consider  the  window  in  its  upper  left  corner  position  on  the 
image  as  shown  in  Figure  12(a).  Before  processing  begins,  subroutine 
MEANFD  calls  subroutine  ADDCOL.  This  subroutine  forms  partial  sms  of 
the  intensities  and  intensity  squares  of  each  column  of  the  Image. 
Each  of  these  columns  is  of  length  WNDROW.  Thus,  IMGCOL  partial  sms 
of  length  WNDROW  will  be  formed  by  subroutine  ADDCOL  before  the  window 
is  moved  from  its  leftmost  position  on  the  Image. 

When  processing  begins,  the  first  WNDCOL  partial  sms  are  summed 
to  obtain  the  element  sms  and  sum -of  'squares  of  all  the  elements 
within  the  window  (see  Figure  10),  and  these  sms  are  stored  in  the 
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variables  CQLSUM  and  SQRSOM  respectively.  As  the  window  moves  £roa 
column  to  column  across  the  image,  COLSUM  and  SQRSUM  are  recomputed 
according  to  equations  (3)  and  (10)  respectively  until  the  last  column 
is  reached.  This  process  is  repeated  each  time  the  window  is  relocated 
at  its  leftmost  position  on  the  image. 

Window  Movement.  In  order  to  move  the  window  across  the  image, 
subroutine  WNDMOV  is  called.  Each  time  this  subroutine  is  called,  the 
window  is  advanced  horizontally  one  column  until  the  rightmost  column 
of  the  window  is  aligned  with  the  rightmost  column  of  the  image.  On 
the  next  call  to  WNDMOV,  the  window  is  moved  back  to  the  position  where 
the  leftmost  column  of  the  window  is  aligned  with  the  leftmost  column 
of  the  image,  and  down  one  row.  This  process  continues  until  the 
rightmost  column  of  the  window  is  aligned  with  the  rightmost  column  of 
the  image  (IMGCOL),  and  the  bottom  row  of  the  window  is  aligned  with 
the  last  row  of  the  image  (IMGROW).  At  this  point,  the  flag  IMGEND  is 
set  to  1  to  signal  the  calling  program  to  terminate  processing.  This 
window  movement  is  shown  pictora.1  T.y  in  Figure  12. 

In  order  to  move  the  window  across  the  image,  four  variables  are 
required  to  specify  the  location  of  the  window  with  respect  to  the 
image.  These  variables  are  stored  in  the  area  COMMON  /MOVE/  and  are 
designated  ROWKNT,  COLKNT,  ROWDIF,  and  COLDIF.  ROWKNT  and  COLKNT 
specify  the  top  row  and  left  column  of  the  window  respectively.  ROWDIF 
and  COLDIF  specify  the  bottom  row  and  right  column  of  the  window 
respectively.  Initially,  ROWKNT  and  COLKNT  are  set  to  1,  and  ROWDIF 
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and  COLDIF  are  sec  to  Che  values  of  WNDROW  and  WNDCOL  respectively.  As 
Che  window  Is  moved  horlzoncally  across  Che  image,  COLDIF  is 
incremenCed  by  COLKNT  +  WNDCOL  and  COLKNT  is  incremenced  by  1  for  each 
new  column  posiCion.  When  COLDIF  is  equal  Co  IMGCOL  when  WNDMOV  is 
called,  ROWDIF  is  incremenced  by  ROWKNT  +  WNDROW,  ROWKNT  is  Incremented 
by  1,  and  COLDIF  is  sec  equal  Co  WNDCOL  and  COLKNT  is  sec  equal  Co  1 
again.  Finally,  when  ROWDIF  is  equal  Co  IMGROW  and  COLDIF  is  equal  Co 
IMGCOL,  Che  window  is  aC  iCs  final  posiCion  on  Che  image  (Figure  12(1)) 
and  IMGEND  is  sec  Co  1  Co  signal  Che  calling  program  chac  Che  end  of 
Che  image  has  been  aCCained.  A  flow  diagram  llluscraclng  Che  method  of 
window  movement  is  shown  in  Figure  20. 

When  subroutine  ADDCOL  is  called,  the  partial  sums  for  each  column 
of  length  WNDROW  are  formed  across  the  entire  image.  Thus,  there  will 
be  IMGCOL  partial  sums.  These  sums  are  stored  in  the  area  COMMON 
/REGL/  in  the  arrays  S(M)  for  the  element  partial  sums,  and  T(M)  for 
the  partial  sums  of  the  element  squares.  In  subroutine  MEANFD,  each 
time  Che  window  is  in  its  leftmost  position  on  the  image,  subroutine 
ADDCOL  is  called  to  form  the  partial  suns  and  the  first  WNDCOL  sums  are 
added  across  the  window  to  form  the  initial  values  of  COLSUM  and 
SQRSUM.  The  mean  is  computed  by  Che  product  of  COLSUM  and  WNDINV,  and 
SQRSUM  is  used  by  subroutine  SVAR  to  compute  the  variance. 

As  Che  window  is  advanced  horlzoncally  across  the  image,  the 
▼•lues  of  COLSUM  and  SQRSUM  are  recursively  updated.  These  updates  are 
formed  by  adding  the  partial  tins  Just  to  the  right  of  the  previous 


COLDIF  «  COLKNT  +  WNDCOL 
COLKNT  *  COLKNT  +  1 


ROWDIF  *  ROWKNT  +  WNDROW 
ROWKNT  »  ROWKNT  +  1 
COLDIF  -  WNDCOL 
COLKNT  -  1 


Window  Movement  Flow  Diagram 


window  position  (given  by  the  present  value  of  COLDIF)  to  the  values  of 
COLS UK  and  SQRSUM,  and  subtracting  the  leftmost  column  sums  of  the 
previous  window  position  (given  by  the  value  of  COLKNT-1).  Thus,  the 
update  equations  are  given  by 

COLSUM  -  COLSUM  +  S(COLDIF)  -  S( COLKNT-1)  (11)  ‘ 

SQRSUM  -  SQRSUM  +  T( COLDIF)  -  T(COLKNT-l)  (12) 

Row  Change  Operation.  After  the  window  has  aoved  across  the  image  the 
first  time  and  advances  to  the  second  row,  the  first  row  of  Intensity 
data  In  the  Intensity  array  I NT  Is  replaced  with  the  first  row  of  data 
from  the  input  buffer  IOBUFR  as  shown  in  Figure  13(b).  In  subroutine 
MEANFD,  after  the  first  pass  of  the  window  across  the  image  (ROWKNT  > 
1),  subroutine  ROWCHG  Is  called  each  time  the  window  returns  to  Its 
leftmost  position,  and  processing  halts  until  the  row  change  operation 
has  transpired. 

Subroutine  ROWCHG  replaces  a  row  of  data  in  the  intensity  array 
INT  with  the  appropriate  row  of  data  from  the  Input  buffer  IOBUFR. 
After  this  row  change  has  taken  place,  byte -to -word  number  conversion 
Is  accomplished  to  Insure  that  the  correct  Intensity  values  are 
transferred  (see  Appendix  G).  As  may  be  seen  by  examining  the  sequence 
of  row  change  operations  shown  in  Figure  13,  the  row  number  of  the 
intensity  array  will  not  always  directly  correspond  to  the  row  number 
of  the  input  buffer.  To  keep  track  of  this  difference,  two  row 
pointers  are  used.  For  the  intensity  srray,  the  pointer  WNDKNT  points 
to  the  new  location  of  where  the  next  row  of  image  data  should  be 


placed.  This  pointer  1 s  reset  to  1  each  tiaa  the  value  of  WNDKNT  is 
equal  to  the  value  of  WNDROW  (it  la  actually  aet  to  aero,  but  becomes  1 
when  Incremented).  This  resetting  of  WNDKNT  Is  shown  In  Figure  13  Cl) 
and  (j). 

For  the  Input  buffer  array,  the  pointer  BUFKNT  points  to  the  new 
location  of  where  the  next  row  of  image  data  should  come  from  when 
transferred  to  the  Intensity  array.  This  pointer  Is  reset  to  1  each 
time  the  value  of  BUFKNT  is  equal  to  the  value  of  L  (assuming  the  end 
of  the  image  has  not  been  reached).  This  resetting  of  BUFKNT  Is  shown 
In  Figure  13  (e),  (f),  and  (g).  The  pointers  WNDKNT  and  BUFKNT,  along 
with  the  value  of  the  current  record  being  processed  (specified  by  the 
value  of  RECNUM),  are  stored  In  the  area  COMMON  /COUNT/. 

After  the  last  row  of  data  is  transferred  from  the  input  buffer  to 
the  Intensity  array,  this  buffer  Is  refilled  with  L  more  rows  of  data 
from  the  Image  file  as  shown  In  Figure  13  (f).  This  Is  accomplished 
when  subroutine  ROWCHG  calls  subroutine  BUFRIN.  Subroutine  BUFRIN  adds 
L  to  the  value  of  the  last  record  input  and  inputs  that  many  new  rows 
of  image  data  Into  the  input  buffer  XOBUFR.  This  Is  accomplished  by 
calling  subroutine  INPUT.  Subroutine  BUFRIN  also  tests  the  value  of 
RECNUM  +  L  to  see  if  it  is  greater  than  IMGROW.  If  so,  the  number  of 
records  input  Is  just  equal  to  IMGROW  -  RECNUM.  Before  these  records 
are  Input,  a  flag  Is  set  (called  EDFLAG)  to  signal  that  the  last  Image 
row  is  to  be  Input.  These  last  Image  rows  are  then  Input,  and  the 
value  of  RECNUM  is  reset  to  1.  This  Is  shown  for  an  arbitrary  choice 


of  Che  lasc  two  data  rows  In  Figure  13  (m),  (n),  and  (o).  A  flow 
dlagraa  Illustrating  che  row  change  operation  Is  shown  In  Figure  21. 

Interesting  Point  Interia  Storage.  In  subroutine  I0P1,  after  the 
simple  variance  has  been  computed  for  each  window  position  by  calling 
subroutine  SVAR,  this  variance  Is  tested  against  the  user -defined 
threshold  value  to  determine  if  an  interesting  point  exists.  If  the 
calculated  value  of  siaple  variance  is  greater  than  the  user-defined 
threshold  value,  an  interesting  point  exists  at  that  window  location, 
and  subroutine  IPSTOR  is  called  to  record  Che  appropriate  information. 
When  IPSTOR  is  entered,  the  number  of  interesting  points  counter 
(IPKNT)  Is  Incremented,  and  the  row  and  column  locations  of  the 
interesting  poLnt  are  stored  In  arrays  IPR  and  IPC  respectively.  To 
compute  these  locations,  the  value  of  WNDRUH  Is  added  to  the  value  of 
Roman  to  obtain  the  row  location  IPROW,  and  the  value  of  WNDCLR  Is 
added  to  the  value  of  COLKNT  to  obtain  the  column  location  IPCOL.  The 
value  of  che  lntereeting  point  is  the  value  of  simple  variance  obtained 
from  subroutine  SVAR,  and  Is  passed  to  IPSTOR  as  a  parameter  in  the 
subroutine  argument  list  as  che  variable  VALOR.  This  variable  is 
assigned  to  the  array  VALOIP. 

In  order  to  keep  the  number  of  Interesting  points  from  becomming 
excessively  large,  the  array  size  for  IPR,  IPC,  and  VALUIP  is 
restricted  to  M.  If  the  value  of  IPKNT  is  greater  than  or  equal  to  M 
after  the  interesting  point  information  has  been  stored,  a  message  that 
the  interesting  point  storage  limit  has  been  exceeded  is  displayed  to 
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Che  user,  and  che  row  and  column  location  of  Che  center  of  Che  window 
where  this  occured  is  princed  on  che  line  printer.  Processing  Chen 
terminates  since  no  more  interesting  points  can  he  stored. 

Interesting  Point  Correlation  Window.  If  the  user  has  requested 
Interesting  point  set  storage  in  subroutine  INTPTS,  the  value  of- IPFLAG 
is  set  equal  to  1,  as  explained  in  the  interesting  point  selection 
subsection  of  Chapter  II.  One  of  the  items  to  be  stored  in  the 
Interesting  point  set  is  the  correlation  window  associated  with  each 
interesting  point.  Thus,  it  is  convenient  to  form  this  correlation 
window  each  time  an  interesting  point  is  selected,  and  store  this 
window  on  a  temporary  scratch  file  until  called  for  permanent  storage 
by  subroutine  IPSOUT. 

Subroutine  IPSTOR  tests  the  value  of  IPFLAG  after  the  interesting 
point  information  has  been  entered  in  arrays  IPR,  IPC,  and  VALUIP.  If 
IPFLAG  is  equal  to  1,  IPSTOR  calls  subroutine  CWDOUT  to  store  the 
correlation  window  surrounding  the  interesting  point  on  a  temporary 
scratch  file.  The  size  of  this  correlation  window  is  determined  by  the 
values  of  CWDROW  and  CWDCOL  defined  by  the  user,  as  previously 
explained. 

Subroutine  CWDOUT  calls  subroutine  CORWND  to  determine  the 
correlation  window  for  the  selected  interesting  point.  CWDOUT  then 


writes  this  correlation  window  (which  is  now  located  in  the  array 
IPWtn»  to  the  temporary  scratch  file  using  the  logical  unit  number 
LUNCW  previously  defined.  A  flow  diagram  illustrating  the  method  of 


Interesting  point  interim  storage  la  shown  in  Figure  22. 

Subroutine  CORWND  forms  the  correlation  window  about  each 
interesting  point  by  first  calling  subroutine  CWDTST  to  determine  the 
start  and  end  locations  of  each  window  row  and  column.  After  this, 
subroutine  INBUFR  is  called  to  input  the  necessary  records  from  the 
image  file  to  form  the  window.  Byte -'to --word  number  conversion  is  then 
performed.  Finally,  the  window  is  broken  up  into  sections  and  formed 
piece-by-piece.  This  is  done  because  the  edges  of  the  correlation 
window  may  extend  beyond  the  edges  of  the  image  for  Interesting  points 
close  to  the  edge  of  the  image.  In  this  case,  the  elements  which 
extend  beyond  the  edge  of  the  image  take  on  the  value  corresponding  to 
the  value  on  the  image  edge.  These  extended  pixels  are  called 
"pseudo -pixels,"  and  may  be  thought  of  as  forming  a  continuous 
extension  of  the  image  boundary  for  the  sole  purpose  of  providing  a 
means  for  totally  and  adequately  defining  the  correlation  window. 

Subroutine  CWDTST  performs  four  tests.  It  first  tests  to  see  if 
the  correlation  window  overlaps  the  left  column  of  the  image  by  setting 
the  variable  CWDLCL  equal  to  the  difference  between  the  value  of  IPCOL 
and  CWDCLH.  If  this  difference  is  less  than  zero,  the  correlation 
window  overlaps  the  left  column  of  the  image  and  the  value  of  the 
correlation  window  column  start  position  is  set  equal  to  1  -  CWDLCL. 
If  IPCOL  -  CWDCLH  is  greater  than  or  equal  to  zero,  CWDCLS  is  set  equal 
to  1.  The  same  test  is  next  performed  for  the  row  starting  position 


using  the  variables  CWDTRW  and  CWDRWS.  The  right  hand  column  of  the 


IPSTOR 
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Figure  22.  Interesting  Point  Interim  Storage  Flow  Diagram 
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linage  is  tested  for  by  setting  the  variable  CWDRCL  equal  to  IMGCOL  - 
( IPCOL  +  CWDCLH)  +1.  If  this  value  Is  less  than  zero,  the  variable 
which  determines  the  end  of  the  correlation  window  columns,  CWDCLE,  Is 
set  equal  to  CWDCOL  +  CWDRCL.  If  CWDRCL  Is  greater  than  or  equal  to 
zero,  CWDCLE  Is  set  equal  to  CWDCOL.  Finally,  the  bottom  row  of  the 
Image  Is  tested  for  by  setting  CWDBRW  equal  to  IMGROW  -  (IPROW  + 
CWDRWH)  +  1.  If  CWDBRW  Is  less  than  zero,  the  variable  which 
determines  the  end  of  the  correlation  window  rows,  CWDRWE,  Is  set  to 
CWDROW  +  CWDBRW.  If  CWDBRW  Is  greater  than  or  equal  to  zero,  CWDRWE  Is 
set  equal  to  1  (not  CWDROW  as  might  be  expected).  The  values  of 
CWDRWS,  CWDCLS,  CWDRWE,  and  CWDCLE  are  returned  to  subroutine  CORWND  to 
be  used  to  form  the  correlation  window. 

After  subroutine  CORWND  calls  CWDTST,  the  record  number  of  the 
first  record  of  the  image  file  used  to  form  the  correlation  window  is 
determined  from  the  value  of  CWDRWS.  The  Initial  value  of  the 
correlation  window  starting  element  (position  within  the  window  of  the 
first  element  to  be  formed)  is  given  by  the  variable  IPCKNT,  and  Is 
also  determined  by  the  value  of  CWDRWS.  The  relative  location  of  the 
Image  data  in  the  records  input  to  form  the  correlation  window  is 
defined  by  the  variable  IMCLST.  After  these  variables  are  defined. 
Image  data  from  the  Image  file  is  input  Into  a  storage  buffer  when 
subroutine  INBUFR  is  called. 

Subroutine  INBUFR  reads  the  record  from  the  Image  file  associated 
with  the  value  of  RECNUM  defined  In  subroutine  CORWND.  Note  that  this 


98 


value  of  RECNUM  Is  totally  Independent  of  the  variable  RECNUM  being 
used  by  the  Interest  operator,  and  It  Is  not  stored  In  a  COMMON  area. 
Uhen  the  correlation  window  Is  formed,  and  control  Is  passed  back  to 
the  Interest  operator  program,  this  value  of  RECNUM  is  lost,  and  the 
value  of  RECNUM  stored  In  the  area  COMMON  /COUNT/  Is  used  to 
determine  records  read  thereafter.  This  Is  perfectly  permlssable  when 
using  direct  access  flies,  and  this  Is  the  reason  that  this  type  of 
file  access  was  chosen.  Subroutine  INBUFR  stores  the  Input  record  In 
the  array  IBUF(M)  In  the  area  COMMON  /1BUF/. 

The  correlation  window  Is  formed  one  row  at  a  time,  and  each  row 
Is  placed  on  Its  proper  location  In  array  IPCWND  after  It  Is  formed. 
The  rows  are  placed  end-to-end  with  the  interesting  point  being  located 
at  the  center  element  of  array  IPCWND.  In  subroutine  CORWND,  after 
byte-to-word  number  conversion  has  been  performed,  correlation  window 
rows  are  formed  depending  on  the  relative  location  of  the  correlation 
window  with  respect  to  the  image.  The  window  Is  then  formed  In 
sections  depending  upon  this  relative  location. 

If  the  value  of  CWDCLS  returned  by  CWDTST  in  subroutine  CORWND  is 
greater  than  1,  this  implies  that  the  leftmost  column  of  the 
correlation  window  overlaps  the  leftmost  column  of  the  Image.  The 
amount  of  this  overlap  is  CWDCLS-l.  After  byte-to-word  number 
conversion  is  performed,  each  record  input  Into  the  byte  buffer  array 
IBUF  is  placed  in  the  Integer  word  array  INTBUF.  Thus,  if  CWDCLS  Is 
greater  than  1,  the  first  CWDCLS-1  elements  of  the  correlation  window 
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row  corresponding  Co  Che  lnpuc  record  ere  given  Che  value  of  INTBUF(l). 
The  window  row  Is  completed  by  copying  Che  elements  scarclng  from 
INTBUF(l)  and  ending  wlch  Che  array  poslclon  corresponding  Co  Che  value 
of  CWDCLE  inCo  Che  array  IPCUND.  However,  If  CWDCLE  extends  Che 
correlaCion  window  row  beyond  Che  rlghCaosc  column  of  Che  Image,  the 
following  CWDCOL  -  (CWDCLE  +1)  row  elements  are  given  the  value  INTBUF 
(IMGCOL).  Thus,  In  theory,  each  correlaCion  window  row  could  begin 
before  the  leftmost  column  of  Che  Image,  and  extend  beyond  the 
rightmost  column,  and  sdll  be  satisfactorily  filled  (although  this 
situation  Is  not  likely  to  occur  In  normal  processing  with  large 
images.) 

In  like  manner,  if  che  value  of  CWDRUS  is  greaCer  Chan  1,  this 
implies  chat  che  uppermost  row  of  Che  correlation  window  overlaps 
(starts  prior  to)  the  uppermost  row  of  Che  Image.  The  amount  of  this 
overlap  Is  CWDRWS-l.  Thus,  if  CWDRWS  is  greaCer  Chan  1,  che  flrsc 
CWDRWS-l  rows  of  che  correlaCion  window  are  assigned  che  same  values  as 
Che  correlaCion  window  row  corresponding  Co  Che  firsC  (uppermost)  image 
row.  Recall  Chat  this  row  may  also  overlap  the  image  to  the  left.  In 
this  case,  che  entire  upper  left-hand  corner  of  Che  correlaCion  window 
which  overlaps  che  image  will  contain  the  same  value  as  Che  upper 
left-hand  corner  element  of  che  image.  This  expansion  of  Che  upper 
left-hand  corner  element  of  che  image  into  the  upper-left  hand  portion 
of  the  correlation  window  is  called  "fanning."  The  upper  right-hand 
element,  and  lower  left-  and  rlghc-hand  elements  of  che  image  may  also 
be  fanned  if  the  appropriate  overlap  occurs. 
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Finally,  if  CWDRWE  Is  greater  than  1,  and  RECNUM  is  equal  to 
IMGROW,  this  implies  that  the  bottom  row  of  the  correlation  window  is 
below  the  bottom  row  of  the  image.  Thus,  if  CWDRWE  >  1  and  RECNUM  ■ 
IMGROW,  the  last  CWDROW  •*  (CWDRWE  +■  l)  rows  of  the  correlation  window 
are  assigned  the  same  values  as  the  correlation  window  row 
corresponding  to  the  last  image  row  (IMGROW).  Again,  these  last 
correlation  window  rows  may  overlap  the  image  to  the  left  or  right  such 
that  fanning  will  occur. 

Therefore,  in  a  hypothetical  sense,  the  correlation  window  could 
overlap  the  image  on  the  left,  right,  above,  and  below  simultaneously 
(i.e.,  the  entire  image  enclosed  by  the  correlation  window)  and  still 
be  adequately  formed  by  subroutine  CORWND.  In  this  case,  the 
interesting  point  would  be  at  the  center  of  the  image,  assailing  that 
the  overlap  is  the  same  on  all  sides.  This  case  is  shown  as  a  way  of 
summarizing  all  the  possible  overlap  conditions  in  Figure  23.  The 
arrows  indicate  the  values  that  the  pseudo ’’pixels  take  on  from  the 
coresponding  image  pixels. 

Therefore,  to  select  interesting  points  using  the  simple  variance 
Interest  operator  (I0P1),  a  variance  threshold  is  first  defined  by  the 
user,  and  the  appropriate  parameters  are  initialized.  The  simple 
variance  is  then  computed  and  tested  against  the  user  -  defined 
threshold.  If  the  value  of  simple  variance  computed  is  greater  than 
the  threshold  value,  an  interesting  point  exists  at  the  center  of  the 
window  at  that  location.  The  row  and  column  location  of  the 


interesting  point  are  then  stored  along  with  its  value.  If  Interesting 
point  set  storage  has  been  requested,  the  correlation  window 
surrounding  the  interesting  point  is  formed  and  stored  on  a  temporary 
scratch  file.  Next,  the  processing  window  is  advanced  sequentially  to 
the  next  image  position.  When  this  window  reaches  the  bottom 
right~hand  corner  of  the  image,  processing  terminates  and  control  is 
passed  back  to  the  interesting  point  selection  control  program.  A  flow 
diagram  illustrating  the  method  of  interesting  point  selection  using 
the  simple  variance  Interest  operator  is  shown  in  Figure  24. 
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Directed  Variance  Interest  Operator 

Again,  consider  the  n  x  m  dimensional  array  of  numbers,  A.  The 
directed  variance  is  the  minimum  root'^mean-square  (RMS)  directed 
difference  over  the  array  area  [Ref.  9s  (3-26)].  To  compute  the 
directed  variance,  aims  of  the  squares  of  the  differences  of  the 
elements  of  A  are  formed  in  four  directions.  These  four  directional 
variances  are  expressed  as 
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(13) 

(14) 

(15) 

(16) 
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In  Che  above  equations,  Di  is  Che  dlreeClooal  variance  of  Che  sun 
of  Che  squares  of  Che  differences  of  each  row  of  A,  D2  is  Che 
direcCional  variance  of  Che  sum  of  Che  squares  of  Che  differences  of 
each  column  of  A,  D3  is  Che  direcCional  variance  of  Che  sum  of  Che 
squares  of  Che  differences  of  Che  upper-Co -lower  diagonal  elemenCs  of 
A,  and  D4  is  Che  direcCional  variance  of  Che  sum  of  Che  squares  of  Che 
differences  of  che  lower -to -upper  diagonal  elemenCs  of  A.  This  is  shown 
below  for  an  arblcraCy  four-element  array  location: 


The  overall  directed  variance,  D,  is  defined  Co  be  Che  minimum  of 
these  four  directional  variances.  Thus 

D  •  MIN  (Di,  Dq,  D3 ,  Di»)  (17) 
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Areas  with  poor  visual  texture  will  have  a  low  directed  variance 
because  adjacent  samples  differ  little  in  any  of  the  four  directions. 
Also,  areas  with  linear  edges  will  exhibit  low  directional  variances  in 
the  direction  of  the  edge.  Conversely,  areas  with  high  directed 
variances  should  avoid  these  defects.  Thus,  interesting  points  are 
defined  to  be  local  maxima  in  this  directed  variance  interest  operator 
[Ref.  9:  (3-4)1. 

In  program  DIDA,  to  select  interesting  points  using  the  directed 
variance  Interest  operator,  the  user  enters  a  2  when  querried 
concerning  the  desired  interest  operator  in  subroutine  IOPSEL,  as 
explained  in  the  Interesting  point  selection  section  of  Chapter  II 
above.  This  entry  causes  IOPSEL  to  call  subroutine  I0P2  which  computes 
the  directed  variance  of  each  processing  window  position,  and  then 
determines  if  an  interesting  point  exists.  If  an  interesting 
point  is  found  to  exist  at  a  certain  window  location, 
it  is  placed  in  arrays  IPR,  IPC,  and  VALUIP  in  the  area 
COMMON  /IPS/.  If  interesting  point  set  storage  has  been 

requested,  the  correlation  window  corresponding  to  the  interesting 
point  is  stored  on  a  temporary  scratch  file,  as  previously  explained. 

To  begin  with,  subroutine  I0P2  calls  subroutine  THRHLD  to  allow 
the  user  to  specify  the  variance  threshold  to  be  used  to  test  for 
interesting  points.  Next,  subroutine  EPSFND  is  called  to  allow  the 
user  to  interactively  specify  a  small  threshold  value  (given  by  the 
variable  EPSLON)  to  be  used  for  the  maximum  directed  variance  tests 


(explained  laCer).  As  usual,  entry  checking  and  correction  are 
provided.  After  EPSFND  is  called,  subroutine  INITAL  is  called  to 
initialize  various  parameters  associated  vith  Interesting  point 
processing . 

To  compute  the  directed  variance  for  each  window  position,  I0P2 
next  calLs  subroutine  DVAR.  This  subroutine  stores  the  computed  values 
in  the  directed  variance  storage  array  D(2,M)  by  calling  subroutine 
DVSTOR.  The  directed  variance  values  are  stored  in  the  first  row  of 
array  D  for  the  Initial  pass  of  the  window  across  the  image  (Figure  12 
(a),  (b),  and  (c)).  Thereafter  (i.e.,  for  the  second  and  subsequent 
window  passes),  these  values  are  stored  in  the  second  row  of  array 
D.  The  number  of  directed  variance  values  stored  in  one  row  of  array  D  is 
determined  by  the  variable  DCOL,  which  is  a  function  IMGCOL  and  WNDCOL. 
Subroutine  DVAR  plays  a  role  similar  to  that  of  subroutine  MEANFD  in 
the  simple  variance  Interest  operator  described  above.  The  variables 
DCOL  and  EPSLON,  and  the  array  D(2,M),  are  stored  in  the  area  COMMON 
/DSTOR/ . 

After  each  value  of  directed  variance  is  computed  and  stored  in 
array  D,  subroutine  WNDHOV  is  called  to  advance  the  processing  window 
one  image  column  (or  row)  position.  When  the  first  row  of  array  D  is 
filled  (i.e.,  the  processing  window  reaches  its  rightmost  position  on 
the  image),  subroutine  MAXDVR  is  called.  This  subroutine  determines 
the  local  maxima  of  the  directed  variance  values  by  comparing  these 
values  with  their  adjacent  neighbors  in  array  D.  After  the  initial 
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window  pass  across  Che  Image,  only  adjacent  neighbors  In  one  row  (che 
first  row)  are  compared.  After  the  second  and  subsequent  passes  of  the 
processing  window,  adjacent  neighbors  of  both  D  rows  are  compared.  The 
directed  variance  value  which  is  greater  than  all  its  adjacent 
neighbors  is  left  positive,  and  all  the  neighbors  are  set  negative. 
Thus,  after  two  passes  of  Che  window  across  the  image,  the  directed 
variances  which  remain  positive  in  the  first  row  of  array  D  are  the  lo¬ 
cal  maxima  for  the  first  pass  of  the  window  across  the  image. 

Since  two  passes  of  the  window  across  the  image  are  required 
before  interesting  points  can  be  selected,  there  is  always  a  phase  lag 
of  one  window  pass  across  the  image  (l.e.,  one  row)  in  the  processing 
cycle.  After  the  second  window  pass,  subroutine  I0P2  tests  the  first 
row  of  directed  variance  values  In  array  D  for  magnitudes  greater  than 
the  user-defined  threshold,  THRESH.  Note  that  all  the  negative  values 
will  never  pass  this  test;  only  the  ones  remaining  positive  which  are 
greater  than  THRESH  (i.e.,  the  local  maxima)  will  pass.  When  a 
directed  variance  value  greater  than  THRESH  is  found,  this  is  an 
interesting  point.  Subroutine  IPSTOR  is  then  called  to  store  this 
interesting  point,  as  explained  previously.  However,  before  IPSTOR  can 
be  called,  ROWKNT  must  be  reduced  in  value  by  1  because  of  the  cyclic 
phase  lag.  The  value  of  COLKNT  is  set  equal  to  the  corresponding  I) 
column  because  the  window  is  in  the  same  column  location  even  though 
there  is  a  one  row  phase  lag.  After  the  interesting  point  has  been 
stored,  ROWKNT  is  incremented  by  1  again,  and  COLKNT  is  returned  to  its 
value  of  DCOL  (which  it  had  achieved  just  prior  to  the  search  of  row  1 
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of  array  D  for  interesting  points).  This  sane  procedure  is  repeated 
for  each  element  of  the  first  row  of  array  D  until  the  last  element  is 
checked. 

When  the  search  of  the  first  row  of  array  D  for  interesting  points 
is  complete,  subroutine  DRWCHG  is  called.  This  subroutine  replaces  the 
contents  of  the  first  row  of  array  D  with  the  contents  of  the  second 
row.  Subroutine  WNDMOV  is  then  called  which  advances  the  window  to  the 
next  image  row  for  processing.  As  the  window  is  passed  across  the 
image  again,  the  computed  directed  variance  values  are  placed  in  the 
second  row  of  array  D.  When  the  window  reaches  its  rightmost  position 
on  the  image,  subroutine  MAXDVR  is  called  to  determine  the  local  maxima 
of  the  directed  variance  values  in  the  first  row  based  on  the  new 
second  row  values.  This  first  D  row  is  then  searched  for  the  local 
maxima  above  THRESH,  as  before.  This  process  continues  until  the  end 
of  the  image  is  reached  ( IMGEND  -  1). 

Recall  that  there  is  a  one  row  phase  lag  involved  in  the 
processing  cycle.  Thus,  when  the  processing  window  reaches  the  end  of 
the  image,  one  row  still  remains  to  be  searched  for  interesting  points. 
These  will  now  be  the  local  maxima  above  THRESH  contained  in  the  second 
row  of  array  D.  Thus,  when  WNDMOV  signals  I0P2  that  the  end  of  the 
image  has  been  attained,  the  second  row  of  array  D  is  searched  for 
interesting  points,  and  interesting  point  processing  is  complete. 
Finally,  subroutine  CLOSKP  is  called  to  close  the  image  file. 

Directed  Variance  Computation.  To  compute  the  directed  variance. 
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subroutine  I0P2  calls  subroutine  DVAR  to  compute  the  four  directional 
variances  as  given  in  equations  (13),  (14),  (15),  and  (16),  and  the 
overall  directed  variance  as  given  in  equation  (17).  The  sums  of  the 
squares  of  the  differences  of  the  intensity  elements  for  each  window 
position  are  stored  in  the  area  COMMON  /DRVAR/  by  the  variables  XSUM, 
YSUM,  ASUM,  and  BSUM.  These  sums  are  formed  by  recursive  updates  the 
same  way  C0LS1IM  and  SQRSUM  were  formed  in  subroutine  ftEANFD,  as 
previously  explained. 

To  form  these  sums,  when  the  processing  window  is  in  its  rightmost 
position  on  the  image,  before  being  passed  across,  subroutine  DVAR 
calls  subroutine  ADDDIF.  This  subroutine  forms  partial  sums  of  the 
squares  of  the  differences  of  the  intensity  elements  in  four  directions 
for  each  column  of  Che  image.  Each  of  these  columns  is  of  length 
WNDROW .  Thus,  the  function  of  subroutine  ADDDIF  is  identical  to  that 
of  subroutine  ADDCOL  mentioned  above  (also  note  equations  (6)  and  (9)). 

In  subroutine  ADDDIF,  the  sums  of  the  squares  of  the  differences 
of  adjacent  elements  for  each  column  of  the  image  are  stored  in  the 
area  COMMON  /REG2 /  in  the  arrays  X(M),Y(M),  A(M) ,  and  B(M) .  The 
elemental  intensity  differences  are  formed  by 


DIFROW  - 

INT(i.j)  - 

INT(i, j,+I) 

(18) 

DIFCOL  - 

INT(i,j)  - 

INT( i+1 , j) 

(19) 

DIFULD  - 

INT( i , j)  - 

INT( i+1 , J+l ) 

(20) 

DIFLUD  - 

INT( 1+1 , j)  - 

INT(i, j+1) 

(21) 

The  squares  of  these  intensity  differences  are  then  placed  in  the 
variables  DFSQRW,  DFSQCL,  DFSQUL,  and  DFSQLU,  and  the  four  column  sums 


are  formed  from  these  squares. 

Note  that  for  the  last  Image  column  position,  no  operation  is 
performed.  In  other  words,  if  the  last  column  is  left  unaccounted  for, 
there  will  be  one  less  partial  sum  than  the  number  of  image  columns. 
To  account  for  this  extra  position,  the  values  of  X(IMGCOL),  A(IMGCOL), 
and  R(IMGCOL)  are  merely  assigned  the  values  X(IMGCOL-l),  A(IMGCOL-l), 
and  3CIMGC0L-1)  respectively.  This  is  nothing  more  than  taking  the 
previous  squared  differences  in  reverse,  which  yield  the  same  value. 
Thus,  they  are  equated.  To  determine  the  last  squared  column 

difference,  the  difference  value  is  formed  by 

DFCLED  -  INT(i.IMGCOL)  -  INT( i+1 , IMGCOL)  (22) 

The  square  of  this  value  is  placed  in  the  variable  DFSOCE.  This 

variable  is  then  used  to  form  the  value  of  Y(IMGCOL).  Having  formed 

the  values  of  all  the  partial  sums,  ADDDIF  passes  control  hack  to 

subroutine  DVAR. 

In  subroutine  DVAR,  each  time  the  window  is  returned  to  its 
leftmost  position  on  the  image,  the  initial  values  of  XSUM,  YSUM,  ASUM, 
and  BSUM  are  formed  by  adding  up  WNDCOL  partial  sums.  As  the  window 
Chen  moves  across  the  image,  these  initial  values  are  recursively 
updated  according  to  the  equations 


XSUM  -  XSUM  +  X(COLDIF)  -  X(C0LKNT-1 )  (23) 
YSUM  -  YSUM  +  Y(COLDIF)  -  Y(COLKNT-l)  (24) 
ASUM  -  ASUM  +  A(COLDIF)  -  A(COTJINT-l)  (25) 
BSUM  -  BSUM  +  B(COLDIF)  -  B(COLKNT-l)  (26) 
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The  four  directional  variances  DVAR1,  DVAR2,  DVAR3,  and  DVAR4  are  then 
computed  by  the  product  of  WNDINV  and  the  corresponding  value  of  XSUM, 
YSUM,  ASUM,  and  BSUM.  Therefore,  the  final  value  of  overall  directed 
variance  for  each  window  position  Is  given  by 

DIRVAR  -  MIN(DVAR1,  DVAR2 ,  DVAR3 ,  DVAR4)  (27) 

Aa  in  the  case  of  subroutine  MEANFD,  each  time  the  window  returns  to 
its  leftmost  position  on  the  image  after  the  first  row  has  been 
processed,  subroutine  ROWCHG  is  called  to  interchange  the  corresponding 
Intensity  array  and  input  buffer  rows  (see  Figure  21). 

Directed  Variance  Local  Maxima.  Once  a  row  of  directed  variance 
values  have  been  stored  in  array  D,  subroutine  MAXDVR  is  called.  This 
subroutine  is  divided  into  two  main  sections:  (1)  test  for  local 
maxima  of  the  first  row  of  directed  variance  values;  and  (2)  tests  for 
local  maxima  using  both  rows  of  directed  variance  values  after  the 
initial  row  has  been  tested.  In  the  single  row  test,  each  elemjnt  is 
compared  with  its  adjacent  neighbor  as  the  row  is  scanned  from  left  to 
right.  The  dual  row  test  is  broken  up  Into  three  parts:  (1) 
comparison  of  the  left-end  three  elements  of  array  D;  (2)  comparison  of 
the  five  middle  elements  of  array  D  as  the  array  is  scanned  from  left 
to  right;  and  (3)  comparison  of  the  right-end  four  elements  of  array 
D. 

In  the  single  row  tests,  as  the  row  is  scanned,  the  element  to  the 
right  is  subtracted  from  the  absolute  value  of  the  preceeding  element. 


If  this  difference  is  greater  than  or  equal  to  the  user-defined 
threshold,  EPSLON,  this  implies  that  the  left-hand  element  is  larger 
than  the  right-hand  element.  Thus,  the  right-hand  element  is  set 
negative  and  the  test  proceeds  to  the  next  sequential  element  pair. 
Note  that  the  absolute  value  of  the  right-hand  element  does  not  have  to 
be  taken  since  this  element  will  always  be  positive  prior  to 
comparison.  However,  the  left-hand  element  could  have  been  set 
negative  by  the  previous  test.  Thus,  its  absolute  value  must  be 
compa  red . 

On  the  other  hand,  if  the  above  test  difference  is  less  than 
EPSLON,  this  implies  that  the  element  on  the  right  is  larger  than  the 
element  on  the  left.  In  this  case,  this  element  is  tested  to  see  if  it 
has  already  been  set  negative.  If  so,  no  action  is  taken.  If  not,  it 
is  set  negative,  and  the  test  proceeds  to  the  next  sequential  element 
pair. 

In  the  dual  row  tests,  two  forms  of  comparison  are  used.  The 
first  form  is  to  compare  the  difference  of  the  two  elements  being 
tested  to  see  if  this  difference  is  greater  than  or  equal  to  the 
user-s peel fled  value  of  EPSLON.  The  second  form  is  to  compare  the 
elemental  difference  to  see  if  it  is  strictly  greater  than  EPSLON. 
These  two  comparison  test  forms  are  applied  alternately  on  each 
successive  call  to  subroutine  MAXDVR  from  I0P2.  In  other  words  on  an 
arbitrary  call  to  MAXDVR  sometime  after  processing  has  begun,  if  the 
greater  than  or  equal  to  test  is  applied,  then  on  the  next  call  to 

l’*' 


MAXDVR,  the  strictly  greater  than  test  is  applied.  This  alternating 
comparison  sequence  continues  until  the  last  image  row  has  been 
processed. 

The  reason  for  alternating  between  greater  than  or  equal  to  and 
strictly  greater  than  comparison  test  forms  Is  to  treat  values  of 
directed  variance  which  are  local  maxima  and  close  to  each  other  in 
absolute  value.  Consider  the  test  of  two  neighboring  elements  of  array 
D.  If  the  difference  of  the  absolute  values  of  these  elements  is 
greater  than  EPSLON,  the  smaller  element  is  set  negative.  Now  assume 
that  the  larger  of  these  two  elements  is  a  local  maximum.  In  this 
case,  it  will  emerge  non-negative  after  completion  of  the  test 
sequence.  If  the  greater  than  or  equal  to  test  is  being  applied,  the 
same  element  will  emerge  non-negative  for  an  elemental  difference  equal 
to  EPSLON  as  well  as  for  an  elemental  difference  greater  than  EPSLON. 

This  selection  of  the  same  non-negative  element  for  the  case  where 
the  elemental  difference  is  either  greater  than  or  equal  to  EPSLON 
introduces  a  bias  into  the  placement  of  the  interesting  points  on  the 
image  being  processed.  Consider  the  case  when  EPSLON  is  equal  to  zero. 
In  this  case,  if  the  elemental  difference  is  zero,  both  elements  are 
equal,  but  the  element  set  negative  is  the  same  as  if  the  test  result 
had  been  greater  than  zero.  There  is  no  reason  to  select  this  element 
as  being  negative  over  the  other  one  if  both  elements  are  equal  (and 
are  local  maxima). 

Now  consider  the  strictly  greater  than  comparison  test.  For  the 
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case  of  EPSLON  equal  Co  zero,  if  che  elemental  difference  is  zero,  che 
element  opposice  Che  one  seC  negaCive  in  Che  greaCer  Chan  or  equal  Co 
CesC  is  sec  negaCive.  If  boch  elements  are  locally  maximal,  Chen  this 
oppposiCe  elemenc,  rather  chan  che  ocher  one,  will  also  emerge 
non-negative  at  the  contplecion  of  the  test  sequence.  Therefore,  by 
alternating  between  che  two  comparison  test  forms,  Che  bias  introduced 
by  using  only  che  greater  chan  or  equal  Co  CesC  is  removed. 

The  magnitude  of  EPSLON  is  generally  kept  small.  For  the  tests 
performed  in  chis  effort,  a  value  of  EPSLON  equal  to  1  was  used.  The 
value  of  EPSLON  determines  the  amount  of  difference  in  absolute  values 
of  the  elemental  neighbors  of  array  0  the  alternating  test  sequence 
will  allow  before  switching  the  element  that  gets  set  negative.  As 
mentioned  above,  when  EPSLON  is  zero,  this  difference  is  also  zero. 
For  EPSLON  equal  to  1,  the  two  neighboring  elements  of  D  can  differ  in 
absolute  value  by  1  and  the  same  element  will  still  be  set  negative  in 
boch  comparison  forms.  However,  if  this  difference  exceeds  1,  then  the 
element  opposice  the  one  set  negative  in  the  greater  than  or  equal  to 
test  will  be  set  negative  in  the  strictly  greater  than  test.  Allowing 
values  of  EPSLON  other  than  zero  gives  Che  user  a  certain  amount  of 
latitude  in  specifying  how  close  two  variance  values  must  become 
before  being  treated  as  the  same  value  for  purposes  of  comparison 
testing. 

To  begin  the  dual  row  tests  after  MAXDVR  is  called,  the  left-end 
three  elements  of  array  D  are  compared  as  shown  below: 


1 


2 


3 


DCOL 


ARRAY  D 


In  this  case,  the  absolute  value  of  element  D(l,l)  is  first  compared 
with  element  0(2,1)  using  one  of  the  comparison  test  forms.  It  is  not 
necessary  to  compare  the  absolute  value  of  D(2,l)  here  since  it  cannot 
be  negative.  Next,  the  absolute  value  of  D(l,2)  is  compared  with  the 
absolute  value  of  0(2,1).  In  this  case,  the  absolute  value  of  0(2,  1) 
must  be  compared  because  D(2,  1)  could  have  been  set  negative  in  the 
first  test. 

After  the  three  left-end  elements  have  been  tested,  the 
intermediate  mid-row  elements  of  array  D  are  tested  five  at  a  time  as 
the  array  is  scanned  from  left  to  right  as  shown  below: 
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For  the  1-th  comparlslon  test,  0(2,1)  is  first  compared  with  the 
absolute  value  of  D(l,i).  Note  here  that  if  0(2,1)  is  greater  than  or 
equal  to  (or  strictly  greater  than  depending  upon  which  test  form  is 
being  used)  the  absolute  value  (ABS)  of  0(1,1),  and  0(1,1)  itself  is 


positive,  then  the  test  need  not  proceed  any  further.  D(l,l)  positive 
means  it  is  larger  than  D(l,i-1)  and  D(2,i-1)  from  the  previous  test. 
Thus,  since  D(2,i)  is  larger  than  D(l,i),  it  is  also  larger  than  these 
other  values.  Since  D(l,i+1)  will  be  compared  on  the  next  test,  the 
scan  can  proceed  to  the  (i+l)-th  comparison  test.  Other  such 
simplifications  are  performed,  where  appropriate,  to  reduce  the  amount 
of  time  required  for  each  portion  of  the  test  sequence  (and  thus  reduce 
the  total  amount  of  processing  time).  However,  in  the  worst  case,  all 
four  comparisons  of  the  five  elements  must  be  performed. 

To  complete  the  dual  row  tests,  the  right-end  four  elements  of 
array  D  are  compared  as  shown  below: 

1  2  3  4  5  -  DCOL 

1 
2 


As  in  the  case  of  the  intermediate  row  tests,  D(2,DC0L)  is  first 
compared  with  ABS(D( 1 ,DCOL) ).  If  D(2,DC0L)  is  greater  than  (or  greater 
than  or  equal  to)  ABS(D( 1 , DCOL) ),  and  D(1,DC0L)  is  positive,  the  test 
ends.  Note  here,  as  before,  that  D(1,DC0L)  positive  implies  that  it  is 
larger  than  D(l.DCOL-l)  and  D(2,DC0L-1).  Thus,  if  D(2,DC0L)  is  larger 
than  ABS  (D(1,DC0L)),  and  D(1,DC0L)  is  positive,  then  D(2,DC0L)  is  also 
larger  than  D(1,DC0L-1)  and  D(2,DC0L-1),  and  testing  need  not  proceed 
any  further. 
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After  the  completion  of  the  right-end  element  comparisons,  the  dual 
row  test  sequence  is  complete,  and  control  passes  from  subroutine 
MAXDVR  to  I0P2.  The  elements  remaining  positive  in  the  first  row  of 
array  D  will  be  the  local  maxima  upon  which  interesting  point  selection 
is  based.  If  the  debug  version  of  program  DIDA  is  being  executed,  both 
rows  of  array  0  are  printed  on  the  line  printer  after  the  test  sequence 
is  complete. 

Therefore,  to  select  interesting  points  using  the  directed 
variance  interest  operator  (I0P2),  the  variance  threshold  and  value  of 
EPSLON  are  first  defined  by  the  user,  and  the  appropriate  parameters 
are  initialized.  The  directed  variance  value  for  each  window  position 
is  then  computed  and  stored.  After  one  complete  pass  of  the  window 
across  the  image,  the  local  maxima  of  the  stored  directed  variance 
values  are  determined.  After  two  complete  passes  of  the  window,  these 
local  maxima  are  tested  against  the  user-defined  variance  threshold  to 
determine  if  an  interesting  point  exists.  If  so,  subroutine  IPSTOR  is 
called  to  store  the  interesting  point  (along  with  its  associated 
correlation  window,  if  requested).  When  the  processing  window  reaches 
the  lower  right-hand  corner  of  the  image,  the  last  row  of  directed 
variance  values  is  tested  for  interesting  points  and  processing 
terminates.  A  flow  diagram  illustrating  the  method  of  interesting 
point  selection  using  the  directed  variance  interest  operator  is  shown 
in  Figure  25. 

Edged  Variance  Interest  Operator 
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I0P2 


Figure  25.  Directed  Variance  Interest  Operator  Flow  Diagram 
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Edged  variance  is  a  function  of  both  simple  variance  and  directed 
variance.  To  compute  the  edged  variance  over  a  given  window  position, 
the  four  directional  variances  DVAR1,  DVAR2,  DVAR3 ,  and  DVAR4  are 
computed  as  explained  in  the  directed  variance  Interest  operator 
section  above.  Four  perpendicular  ratios  of  these  directional 
variances  are  then  formed  as  a  measure  for  determining  the  presence  of 
an  edge  within  the  window  area.  This  measure  takes  advantage  of  the 
fact  that  a  window  with  a  strong  edge  within  it  will  have  a  much 
greater  information  content  across  the  edge  than  along  it.  The  minimum 
of  these  four  ratios  provides  a  measure  of  the  relative  strength  of  the 
Information  parallel  to  the  dominant  edge  within  the  window  area, 
independent  of  the  contrast  of  the  image.  Since  this  measure  does  not 
give  any  indication  of  the  amount  of  information  within  the  window,  it 
is  multiplied  by  the  simple  statistical  variance  to  produce  the  edged 
variance.  The  method  of  computing  the  simple  variance  is  described  in 
the  simple  variance  Interest  operator  section  above.  Thus,  the  edged 
variance,  E,  is  given  by  [Ref.  9:  (3-5)J 


E 


V  {MINC-gJ-, 


D2  _D3_  D4 
D1  ’  D4  ’  D3  J' 


(28) 


In  the  above  equation,  V  is  the  simple  statiscal  variance  computed  by 
equations  (1)  and  (5).  Di ,  D2,  T)3,  and  D4  are  the  four  directional 
variances  given  by  equations  (13),  (14),  (IS),  and  (16)  respectively. 


In  program  DIOA,  to  select  interesting  points  using  the  edged 
variance  operator,  the  user  enters  a  3  when  querried  concerning  the 


desired  interest  operator  in  subroutine  IOPSEL,  as  explained  in  the 
interesting  point  selection  section  of  Chapter  II  above.  This  entry 
causes  IOPSEL  to  call  subroutine  I0P3  which  computes  the  edged  variance 
of  each  window  position,  and  then  determines  if  an  interesting  point 
exists.  If  an  interesting  point  is  found  to  exist  at  a  certain-  window 
location,  it  is  placed  in  arrays  IPR,  IPC,  and  VALUIP  in  the  area 
COMMON  /IPS/.  If  Interesting  point  set  storage  has  been  requested,  the 
correlation  window  corresponding  to  the  Interesting  point  is  stored  on 
a  temporary  scratch  file,  as  previously  explained. 

To  begin  with,  subroutine  I0P3  calls  subroutine  THRHLD  to  allow 
Che  user  to  specify  Che  variance  threshold  to  be  used  to  test  for 
Interesting  points.  Next,  subroutine  INITAL  is  called  to  initialize 
various  parameters  associated  with  interesting  point  processing.  To 
select  the  Interesting  points,  subroutine  EVAR  is  called  which  returns 
the  value  of  edged  variance  for  a  given  window  position.  This  value  of 
variance  (specified  by  the  variable  EDGVAR)  is  then  tested  against  the 
use r-de fined  threshold.  If  the  value  of  EDCVAR  is  greater  than  the 
value  of  THRESH,  an  interesting  point  exists  at  that  window  location, 
and  subroutine  IPSTOR  is  called  to  store  the  location  and  value  of  the 
Interesting  point  (and  Che  correlation  window,  if  requested),  finally, 
subroutine  WNDMOV  is  called  to  advance  the  window  to  the  next 
sequential  row  and  column  position  (see  Figure  12).  If  the  last  window 
position  is  detected  by  subroutine  WNDMOV  (Figure  12(1)),  interesting 
point  processing  is  complete  and  subroutine  CLOSKP  is  called  to  close 
the  image  file. 
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Edged  Variance  Computation.  To  compute  the  edged  variance  at  each 
window  position,  subroutine  EVAR  first  calls  subroutine  SVAR  to  compute 
the  simple  variance.  Next,  subroutine  DVAR  is  called  to  compute  the 
four  directional  variances  DVAR1 ,  DVAR2 ,  DVAR3 ,  and  DVAR4 .  When 
subroutine  EVAR  is  entered,  the  edged  variance  flag  EFLAG  is  set  equal 
to  1  to  signal  subroutine  DVAR  that  the  edged  variance,  rather  than  the 
directed  variance,  is  being  computed.  After  the  four  directional 
variance  values  have  been  computed,  subroutine  RATIO  is  called  to 
calculate  the  four  perpendicular  ratios  of  these  values  according  to 
equation  (28). 

Subroutine  RATIO  receives  the  values  of  the  four  directional 
variances  from  subroutine  DVAR  and  returns  the  values  of  the  four 
perpendicular  ratios  according  to  the  following  equations. 


RATI01 

-  DVAR1/DVAR2 

(29) 

RATI02 

-  DVAR2/DVAR1 

(30) 

RATI03 

-  DVAR3/DVAR4 

(31) 

RATI04 

-  DVAR4/DVAR3 

(32) 

This  subroutine  also  tests  the  divisor  in  each  equation  for  a  zero 
value  prior  to  dlvlson.  If  it  is  zero,  a  large  number  is  assigned  to 
that  ratio.  If  both  numerator  and  denominator  are  zero,  the  ratio  is 
set  to  zero. 

After  subroutine  RATIO  returns  the  values  of  the  above  four  ratios 
to  subroutine  DVAR,  the  minimum  of  these  ratios  is  obtained  by 


RTOMIN  -  MIN(RATI0l,RATI02,RATI03,RATI04) 


(33) 


This  value  of  Che  mininun  of  Che  four  ratios,  along  with  the  value  of 
EFLAG  is  stored  in  the  area  COMMON  /EDVAR/.  Thus,  when  subroutine  DVAR 
returns  control  to  subroutine  EVAR,  the  value  of  edged  variance  is 
computed  by  the  simple  expression 

EDGVAR  -  VARNCE*RTOMIN  (34) 

Therefore,  to  select  interesting  points  using  the  edged  variance 
interest  operator  (I0P3),  a  variance  threshold  is  first  defined  by  the 
user,  and  the  appropriate  parameters  are  initialized.  The  edged 
variance  is  then  computed  and  tested  against  the  user-defined 
threshold.  If  the  value  of  edged  variance  conputed  is  greater  than  the 
threshold  value,  an  interesting  point  exists  at  the  center  of  the 
window  at  that  location.  The  row  and  column  location  of  the 
Interesting  point  are  then  stored  along  with  its  value.  If  interesting 
point  set  storage  has  been  requested,  the  correlation  window 
surrounding  the  interesting  point  is  formed  and  stored  on  a  temporary 
scratch  file.  Next,  the  processing  window  is  advanced  sequentially  to 
the  next  image  position.  When  this  window  reaches  the  bottom 
right-hand  corner  of  the  image,  processing  terminates  and  control  is 
passed  back  to  the  interesting  point  selection  control  program.  The 
flow  diagram  illustrating  the  method  of  interesting  point  selection 
using  the  edged  variance  interest  operator  is  Identical  to  the  flow 
diagram  of  the  simple  variance  Interest  operator  shown  In  Figure  24. 
The  only  difference  is  that  subroutine  EVAR  is  called  after  subroutine 
INITAL  rather  than  subroutine  SVAR. 
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V 


Interest  Operator  Evalua tlon 

Each  of  the  above-mentioned  Interest  operator?  functions 
differently  depending  upon  the  specific  application  in  which  it  is 
being  used.  Simple  statistical  variance  has  a  low  value  in  areas  of 
low  information  content.  The  directed  variances  will  also  be  small  in 
areas  of  low  information  content.  However,  if  the  area  has  a  strong 
linear  edge  with  little  information  on  either  side,  then  the 
directional  variance  which  most  nearly  parallels  the  edge  will  he 
small.  By  defining  the  interest  measure  to  be  the  maximum  of  the 
minimums  of  the  directed  variances,  areas  with  low  information  content, 
and  even  uni-directional  information,  can  be  rejected.  Thus,  simple 
variance  and  directed  Interest  operators  find  points  along  the  strong 
irregular  edges  which  mark  tree/grass  boundaries,  corners  of  buildings, 
object  outlines,  and  other  such  image  features,  and  ignore  open  areas 
having  more  subtle  features.  On  the  other  hand,  edged  variance  gives 
a  combination  of  strong  and  subtle  features,  while  avoiding  excessively 
plain  areas. 

On  the  basis  of  pure  performance,  edged  variance  should  provide 
the  best  Interest  measure.  However,  it  is  computationally  the  roost 
expensive,  requiring  the  calculation  of  six  sums  (five  of  which  are 
squared  quantities),  five  divides,  a  MINIMUM  operation,  and  seven 
multiplies.  Directed  variance  is  less  expensive,  requiring  four  suras 
(all  of  squared  quantities),  a  divide,  a  MINIMUM,  and  four  multiplies. 
Simple  statistical  variance  is  the  cheapest,  requiring  only  two  sums 
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(of  which  only  one  is  a  square),  two  multiplies,  and  a  divide 


If  the  image  to  be  processed  contains  mostly  natural  terrain,  the 
edge  rejection  properties  of  directed  variance  and  edged  variance  are 
not  needed.  In  this  case,  the  cheaper  simple  variance  interest 
operator  should  be  used.  If  the  images  contain  many  linear  features, 
such  as  roads,  houses,  and  so  forth,  then  strictly  linear  edge 
rejection  is  important.  In  these  cases,  the  directed  variance  interest 
operator  is  the  perferred  choice.  In  images  which  contain  relatively 
featureless  terrain,  the  increased  performance  of  edged  variance  is 
needed.  However,  if  the  terrain  provides  fairly  contrasty  images,  the 
cheaper  directed  variance  operator  may  be  employed  [Ref.  9: 
( 3—2  6 )— ( 3— 29 ) ] . 
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IV.  Interesting  Point  Matching  Algorithms 


Without  citing  nany  examples,  the  applications  of  CATVI  are  many 
and  varied.  Of  these,  tracking  is  perhaps  the  most  obvious.  Two  types 
of  trackers  can  be  distinguished:  (l)  background  trackers;  and  (2) 
target  trackers.  A  background  tracker  identifies  an  object  in  the 
background  of  an  image  (a  house,  for  example),  and  monitors  the 
location  of  that  object  as  the  imaging  sensor  moves  past  it.  Target 
tracking  on  the  other  hand,  occurs  when  the  movement  of  an  object 
relative  to  the  background  must  be  monitored  [Ref.  10:  7].  As  an 
example  of  this,  consider  the  moving  enemy  tank  mentioned  on  page  1  of 
the  introduction  section.  In  order  for  the  airborne  munitions  platform 
to  destroy  this  tank,  it  must  be  able  to  track  the  tank  as  it  moves, 
while  preparing  to  discharge  weaponry  against  it.  As  the  imaging 

sensor  of  the  platform  receives  sequential  images  of  the  target  area, 
the  movement  of  the  tank  within  these  images  creates  a  disparity  fron 
one  image  to  the  next,  as  mentioned  at  the  beginning  of  Chapter  III. 
The  first  question  which  might  arise  then  is  how  the  movement  of  the 
tank  can  be  tracked  from  image-to-image. 

One  method  of  accomplishing  this  tracking  is  to  use  disparity 
analysis.  Using  an  interesting  point  selection  algorithm.  Interesting 
points  (in  this  case,  points  on  the  tank)  can  be  located  in  each  image. 
However,  merely  locating  the  interesting  points  in  each  image  does  not 
provide  sufficient  Information  to  track  the  tank.  In  order  to  track 
it,  the  interesting  points  on  the  tank  in  one  image  must  be  identified 
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In  Che  next  image  as  being  Che  same  point.  This  process  of  identifying 
the  same  interesting  points  from  image-to-image  is  called  "matching. ” 

Matching  Is  a  natural  way  to  approach  disparity  analysis  [Ref.  4: 
333].  Doughterty  accomplishes  this  matching  by  similarity  detection 
which  minimizes  the  norm  of  the  difference  between  two  images  [Ref.  17: 
31].  A  method  which  assigns  probabilities  to  each  potential  candidate 
match  point  using  the  method  of  relaxation-labeling  is  suggested  by 
Barnard  and  Thoopson  [Ref.  4:  335-336].  This  is  the  method  discussed 
below.  In  still  another  approach,  Hannah  uses  reduction  matching 
accomplished  by  maximizing  the  normalized  cross-correlation  over  small 
windows  surrounding  the  Interesting  points  [Ref.  12:  203].  In  this 

case,  a  simple  spiraling  grid  search  is  used  to  obtain  a  precise  match 
[Ref.  9:  (3-5)]. 

Interesting  point  matching  is  the  very  heart  of  disparity  analysis 
since  it  forms  the  basis  for  the  extraction  of  all  pertinent 
information  from  lmage-to-lmage.  During  this  thesis  effort,  matching 
was  accomplished  by  successive  approximation  under  a  probabilistic 
relaxation-labeling  scheme  as  described  by  Thompson  and  Barnard  [Ref. 
18:  24-25]  and  more  generally  by  Zucker,  LeClerc,  and  Mohammed  [Ref. 
19:  117-123].  The  relaxation-labeling  method  uses  iterative 

probabilistic  classification  (matching)  rather  than  making  firm 
classification  decisions  Immediately.  Classification  probabilities  at 
a  given  iteration  are  allowed  to  depend  on  decisions  made  at  the 
previous  iteration.  The  probability  updating  at  a  given  iteration  is 


done  In  parallel  over  Che  entire  Image  [Ref.  20:  79]. 

In  Che  studies  discussed  above,  three  properties  of  Image  pairs 
which  can  strongly  influence  the  matching  process  can  be  identified: 
(1)  discreteness;  (2)  similarity;  and  (3)  consistency.  Discreteness  is 
a  measurement  of  the  individual  distinctness  of  a  point,  and  is 
important  for  selecting  good  candidate  points  for  matching.  Of  the 
interest  operators  discussed  in  Chapter  III,  the  Moravec  Operator 
(IOP2)  provides  distinct  points  because  of  the  way  it  selectively 
isolates  the  local  maxima  of  the  directed  variances.  Similarity  is  a 
measure  of  how  closely  two  points  resemble  one  another.  Finally, 
consistency  is  a  measure  of  how  well  a  particular  match  (that  is,  a 
particular  disparity  classification)  conforms  to  nearby  matches.  The 
continuity  of  disparity  over  most  of  the  image  can  be  used  to  avoid 
false  matches  based  on  similarity  alone  by  suppressing  matches  in  the 
absence  of  supporting  local  evidence  [Ref.  4:  334],  The  discreteness, 
similarity,  and  consistency  properties  all  may  Interact  to  enhance  the 
overall  performance  of  the  matching  algorithm. 

To  perform  matching,  the  first  step  is  to  find  the  interesting 
points  in  the  two  images  to  be  matched.  This  is  accomplished  by 
applying  the  interest  operator  independently  to  each  image,  and 
rejecting  points  with  locally  maximal  but  very  small  variances  by 
adjusting  the  threshold  value.  This  threshold  should  be  adjusted  to 
produce  a  reasonable  nunber  of  points  on  each  image,  expressed  as  a 
percentage  of  the  total  number  of  image  pixels. 


After  the  two  sets  of  interesting  points  (now  called  candidate 

points)  are  found,  the  next  step  is  to  construct  a  set  of  possible 

matches.  An  initial  set  of  possible  matches  is  constructed  by  pairing 

each  candidate  point  from  image  1  with  every  candidate  from  image  2 

within  some  maximum  distance  (disparity  window)  of  the  (x,y)  location 

of  the  point  in  image  1.  This  distance  is  the  maximum  detectable 

disparity  in  the  x  or  y  direction.  The  set  of  possible  matches  is 

organized  as  a  collection  of  "nodes"  (a^J.  One  node  exists  for  each 

candidate  point  from  image  1.  Associated  with  each  node  a^  is  a  set  of 

coordinates  (x^,  y^)  which  is  the  location  of  the  point  in  image  1,  and 

a  set  of  labels  which  represent  possible  disparities  that  may  be 

assigned  to  the  point.  Each  label  in  is  either  a  disparity  vector 

(1  ,  1  )  ,  or  it  is  a  distinguishing  label  1*,  denoting  an  "undefined 
x  y 

disparity."  A  node  a^  has  an  undefined  disparity  if  point  (x^,  y^)  in 

image  1  does  not  correspond  to  any  candidate  point  in  image  2.  The 

point  (x^,  y^)  in  image  1  is  tentatively  matched  to  a  point  (x,y)  in 

image  2  within  the  disparity  window  of  a^  by  entering  a  label  1  ■ 

(Xj-x.y^-y)  into  L^.  For  every  node  a^,  an  estimated  probability  p^(l) 

is  associated  with  every  label  1*(1  ,  1  )  in  L . .  This  is  the 

x  y  x 

probability  that  the  point  (x^,  y^)  in  image  1  has  disparity  1.  Thus, 
p^(l)  is  in  (0,1],  and  the  sum  of  the  individual  label  probabilities 
must  equal  1.  As  mentioned  above, 'these  probability  estimates  will  be 
successively  improved  by  applying  the  consistency  property. 

The  initial  probabilities  p^°(l)  are  based  on  an  algorithm  which 
compares  the  correlation  windows  of  the  candidate  points  from  image  1 


with  chose  of  image  2.  When  these  correlation  windows  are  similar,  the 


difference  between  them  will  be  small.  In  this  case,  p^°(l)  should  be 
large.  Thus,  if  s^(l)  is  a  measure  of  the  difference  between  the 
correlation  windows,  then  a  weight  w^(l)  may  be  defined  as 


*^(1) 


1+c  si(l) 


(1  *  1*) 


(35) 


This  is  the  weight  associated  with  the  label  1  of  node  a^  ( c  is  merely 
an  arbitrary  constant).  Note  that  if  no  label  has  a  high  weight,  then 
there  is  probably  no  valid  match.  Therefore,  the  initial  estimate  of 
the  probability  that  the  point  (x^,y^)  in  image  1  corresponds  to  no 
point  in  image  2  is  given  hy 

p.°(l*)  -  1  -CMAX  w  (1)]  (36) 

1*1*  i 

Next,  Bayes'  Rule  can  be  applied  to  determine  the  conditional 
probability  that  a±  has  label  1  given  that  a.^  is  matachable.  This 
conditional  probability  can  be  estimated  as 

Pi(1^i)  "  Z  w7(l)  (37) 

1*1*  1 

The  initial  probability  that  a^  should  be  label  1  for  labels  other  than 
1*  is  then 

pi°(1)  “  PiUlDCl-p^U*)^  (1*1*)  (38) 


Equations  (35),  (36),  (37),  and  (38)  can  be  used  to  calculate  the 

initial  probabilities  for  every  label  of  every  node. 

The  initial  probabilities,  which  depend  only  on  the  similarity  of 


the  candidate  matching  points,  can  be  improved  by  using  the  consistency 

property.  To  update  the  initial  probabilities,  the  new  probabilities 
kf  1 

p^'  (1)  should  tend  to  increase  when  nodes  with  highly  probable  labels 

consistent  with  1  are  found  near  a^.  Labels  are  considered  if  they 
represent  nearly  the  same  disparities  as  given  by 

IU  "  I'll  <  T  (39) 


for  an  appropriate  threshold,  T.  A  node  a^  may  be  considered  near  a^  if 
MAX  { [ x±  -  Xj  |  ,  \y±  -  y  |  }  <.  N  (40) 


where  N  is  the  consistency  neighborhood  for  node  a  . 


The  degree  to  which  the  label  1'  of  a^  reinforces  p^ (1)  is 
directly  related  to  the  estimated  likelihood  that  1'  is  correct.  To 
compute  the  updated  probabilities,  a  consistency  factor  is  defined  as 


q±k  (i) 


a  near  a. 


{£ 


[  1-1 M I <T 


p/u1)} 


(i*i*) 


(41) 


This  factor  is  zero  if  no  nodes  surrounding  a^  have  possible  matches 
with  disparity  labels  similar  to  1.  In  like  manner,  a  consistency 
factor  forp^d*)  is  defined  as 


,k  (1*)  - 

1  a  near  a 

3J*i 


Pk  (1*) 


(42) 


Probability  updates  may  now  be  accomplished  using  the  old  probabilities 
and  the  computed  consistency  factors  as 


P  k+1  (1)  -  Pk  (1)  CA  +  Bqk  (1)3 (1*1*) 


(43) 


and,  for  1* 


Ptk+1  (1*)  -  Pk  (1*)CA  +  Bq^d*)] 


(44) 


The  parameters  A  and  B  are  positive  constants  which  influence  the 
convergence  characteristics  of  the  model.  The  role  of  A  is  to  delay 
the  total  suppression  of  unlikely  labels.  Even  if  q^(l)  is  zero,  the 
value  of  A  ensures  that  the  new  probability  does  not  become  zero 
immediately.  The  role  of  B  is  to  determine  the  rate  of  convergence. 
The  larger  B  is  relative  to  A,  the  faster  will  be  the  convergence  of 
the  disparity  assignments.  Thus,  A  and  B  may  be  interpreted  as  damping 
and  gain  parameters  respectively. 


Finally,  the  p's  are  normalized  to  obtain  the  new  probabilities  by 

..  p,ktl  u) 

>r  «>  ■ . 1  —  <45> 


1’  inL. 
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(1 ') 


and,  for  1* 


k+1  . 

PA  (1*) 


“  k+1 

d*) 

£  p  f  1 ' ) 

1  in  L±  Pi  U  ' 


(46) 


The  probability  update  procedure  is  successively  iterated  until 
the  network  reaches  a  steady  state  condition;  but,  for  the  purposes  of 
this  effort,  the  update  procedure  was  arbitrarily  stopped  at  10 
iterations.  Upon  termination  of  the  update  process,  the  label 
probabilities  are  tested.  Those  nodes  with  a  disparity  label  having  an 
estimated  likelihood  0.7  or  greater  are  considered  to  be  matched.  The 
disparity  label  with  this  high  probability  is  then  added  to  the 
coordinates  of  its  associated  node  to  determine  the  coordinates  of  the 
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point  in  image  2  to  which  it  is  matched.  Note,  however,  that  some  nodes 
may  remain  ambiguous.  That  is,  they  may  retain  several  potential 
matches  having  nonzero  probabilities,  all  of  which  will  be  less  than 
0.5.  In  this  case,  it  is  impossible  to  determine  the  proper  match[Ref. 
4:333-336]. 

In  program  DIDA,  to  natch  interesting  points  using  the 
relaxation-labeling  matching  algorithm,  the  user  enters  a  1  when 
querried  concerning  the  desired  matching  algorithm  in  subroutine 
MTASEL,  as  explained  in  the  interesting  point  matching  section  of 
Chapter  II  above.  This  entry  causes  MTASEL  to  call  subroutine  MTALG1 
which  matches  the  interesting  point  sets  being  compared. 

To  begin  with,  subroutine  MTALG1  calls  subroutine  DWDSZE  to  allow 
the  user  to  specify  the  size  of  the  disparity  window  to  be  used  to  form 
the  disparity  labels  for  each  node.  Specification  of  the  disparity 
window  size  is  accomplished  in  exactly  the  same  manner  as  the 
specification  of  the  processing  window  and  correlation  window  sizes. 
Subroutine  DWDSZE  calls  subroutine  DRCFND  to  obtain  the  number  of 
disparity  window  rows  and  columns.  DRCFND  then  calls  subroutines  DWROW 
and  DWCOL  to  permit  the  user  to  interactively  enter  the  number  of 
disparity  window  rows  and  columns  respectively.  Subroutines  DRCCHK  and 
DRCCOR  are  used  for  entry  error  checking  and  correction,  if  needed. 
The  flow  diagram  for  inputting  the  disparity  window  row  and  column  size 
is  Identical  to  the  one  shown  in  Figure  6. 

The  Information  obtained  after  calling  DWDSZE  is  stored  in  the 
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area  COMMON  /DSPWND/.  The  variables  DWHROW,  DWDCOL,  DWDRWH,  DWDCLH, 
DWDSZE,  and  DWDINV  specify  exactly  the  sane  information  as  the  other 
windows  mentioned  above.  The  range  of  values  for  the  disparity  window 
to  be  specified  is  shown  in  Table  I. 

After  the  disparity  window  size  has  been  specified,  subroutine 

MTALC1  next  calls  subroutine  CWCOMP  to  determine  the  orientation  of  the 

correlation  windows  of  the  two  interesting  point  sets  to  be  matched. 

This  is  accomplished  by  comparing  the  correlation  window  row  and 

column  sizes  of  each  window  to  see  if  they  are  less  than,  equal  to,  or 

greater  than  each  other.  Thus,  since  there  are  three  possible 

conditions  for  each  case,  and  two  tests  per  case  (rows  and  columns), 
2 

there  are  3  *  9  possible  orientations.  CVfCOMP  assigns  a  value  to  the 

variable  CWTEST  based  on  the  orientation  of  the  two  correlation  windows 
(values  range  from  0  to  8),  and  returns  this  value  to  the  calling 
program. 

Next,  >fTALGl  calls  subroutine  W8ASEL  to  allow  the  user  to  select 
the  weighting  algorithm  to  be  used  to  form  the  initial  probabilities 
for  matching.  Subroutine  W8ASEL  operates  in  the  same  fashion  as  the 
other  previously  described  selection  subroutines  (such  as  MTASEL). 
However,  Instead  of  then  calling  the  selected  subroutine,  W8ASEL  merely 
returns  a  value  in  the  variable  W8ANBR  corresponding  to  the  weighting 
algorithm  selected.  This  number  is  passed  to  subroutine  LABELS,  and 
from  LABELS  to  subroutine  W8AFND  to  actually  call  the  weighting 
algorithm  the  user  has  selected.  This  technique  of  assigning  the 


algorithm  number  in  one  subroutine  and  passing  it  to  another  subroutine 
which  calls  for  that  algorithm  is  called  "transferance. ”  After  the 
weighting  algorithm  nunber  has  been  assigned,  subroutine  CONST  is 
called  which  permits  the  user  to  interactively  select  the  constant,  C, 
to  be  used  in  the  weighting  algorithms  (except  for  algorithm-  6,  as 
explained  later).  As  usual,  error  checking  and  correction  is  provided 
in  CONST. 

When  the  disparity  window  size  has  been  established,  the 
orientation  of  the  correlation  windows  determined,  and  the  weighting 
algorithm  (and  constant)  selected,  subroutine  MTAL01  calls  subroutine 
LABELS  to  begin  the  matching  process.  LABELS  determines  the  disparity 
labels  corresponding  to  each  node  formed  by  interesting  point  set  1  by 
differencing  the  x  and  y  coordinate  values  of  each  node  with  the 
interesting  points  from  set  2  lying  within  the  disparity  window  formed 
by  that  node.  After  a  label  is  determined,  subroutine  CWDEQ8  is  called 
to  equate  the  correlation  window  sizes  surrounding  the  interesting 
points  from  each  set  according  to  the  orientation  determined  in 
subroutine  CWCOMP  (given  by  the  variable  CWTEST).  Once  these 
correlation  window  sizes  are  equated,  they  may  be  directly  compared. 
Subroutine  1ABELS  next  calls  the  weighting  algorithm  specified  by  the 
value  of  W8AIIBR  to  compute  a  weight  for  determining  the  initial 
probability  to  be  assigned  to  each  label.  LABELS  then  returns  to 
MTALG1 . 

Next,  MTALG1  calls  subroutine  INPROB  to  determine  the  initial 
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probabilicies  of  each  label  according  to  the  weight  computed  in 
subroutine  LABELS.  After  this,  subroutine  NCHSZE  is  called  to 
determine  the  consistency  neighborhood  to  be  used  to  test  the 
consistency  property  of  each  node  with  other  nodes  which  are  close-by. 
Subroutine  NGHSZE  calls  subroutine  NRCFND  to  obtain  the  nunher  of 
consistency  neighborhood  (hereafter  referred  to  as  just  neighborhood) 
rows  and  columns.  NRCFND  then  calls  subroutines  NGROW  and  NGCOL  to 
permit  the  user  to  interactively  enter  the  number  of  neighborhood  rows 
and  columns  respectively.  Subroutines  NRCCHK  and  NRCCOR  are  used  for 
entry  error  checking  and  correction,  if  needed.  The  flow  diagram  for 
inputting  the  neighborhood  row  and  column  size  is  identical  to  the  one 
shown  in  Figure  6. 

The  information  obtained  after  calling  NGHSZE  is  stored  in  the 
area  COMMON  /NBHOOD/.  The  variables  NGHRCW,  NGHCOL ,  NGHRWH,  NGHCLH, 
NGHSZE,  and  NGHINV  specify  exactly  the  same  information  as  the  other 
windows  mentioned  above.  The  range  of  values  for  the  neighborhood  to 
be  specified  is  shown  in  Table  I. 

After  specifying  the  neighborhood,  MTALG1  calls  subroutine  CONSTS 
to  allow  the  user  to  interactively  input  the  constants  A  and  B  used  to 
compute  the  consistency  factor  for  the  probability  updates.  Subroutine 
THRESH  is  then  called  to  allow  the  user  to  interactively  input  the 
threshold,  T,  for  the  label  consistency  tests.  As  usual,  error 
checking  and  correction  is  provided,  if  needed. 

Finally,  subroutine  MTALG1  calls  subroutine  UDPROB  to  update  the 
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initial  probabilities  based  on  the  consistency  property.  Subroutine 
UDPROB  tests  the  labels  of  the  nodes  within  the  neighborhood  for 
consistency  by  comparing  the  absolute  value  of  the  labels  of  each  node 
pair  with  the  user-defined  threshold.  For  label  differences  smaller 
than  this  threshold,  the  consistency  factor  associated  with  that  label 
probability  is  modified  accordingly.  After  all  the  labels  of  all  the 
nodes  have  been  tested,  the  label  probabilities  for  each  node  are 
updated,  and  the  no-match  probability  for  each  node  is  updated.  When 
the  probability  updates  reach  steady  state  (10  iterations  are  used  for 
this  study),  UDPROB  returns  to  MTALG1.  This  completes  the  matching 
process  and  subroutine  MTALC1  passes  control  to  subroutine  IPMTCH. 

Label  and  Weight  Determination 

r 

To  determine  the  labels  and  weights  associated  with  each  node, 
subroutine  OTALG1  calls  subroutine  LABELS,  as  mentioned  above.  LABELS 
uses  the  value  of  N  (see  Table  I)  to  determine  the  storage  locations 
and  maximum  allowable  number  of  the  labels  and  weights.  To  store  these 
labels  and  weights,  the  VIRTUAL  array  ST0RE(N,M)  is  used.  Note  that 
since  the  weights  (and  later,  the  probabilities)  are  in  the  range 
[0,1],  STORE  must  be  a  REAL*4  array;  thus,  its  size  is  limited  to  N  x  M 
(32  x512).  Each  column  of  array  STORE  contains  the  information  for 
each  node  formed  from  the  interesting  points  of  interesting  point  set 
1.  Thus,  M  nodes  can  be  stored. 

The  first  two  row  positions  of  array  STORE  are  used  to  store  the 
row  and  column  coordinates  (x^.y^)  of  each  node  {a^,  }.  The  third  row  is 
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used  to  score  the  label  count  (total  number  of  labels  and  weights 
stored).  The  labels  are  stored  beginning  in  the  fourth  row  of  STORE. 
These  labels  are  stored  in  pairs  with  the  x- coordinate  difference 
first,  followed  by  the  y- coordinate  difference.  These  differences  are 
given  by  the  variables  LX  and  LY  respectively.  The  x^-  and  y^ 
coordinate  values  of  each  node  are  given  hy  the  variables  IPR0U1  and 
IPC0L1  respectively.  The  weights  are  stored  beginning  in  the  row 
immediately  following  the  storage  location  for  LY  for  the  last  label. 
Since  two  storage  locations  are  required  for  each  label,  only  half  as 
many  storage  locations  are  required  for  the  weights  as  for  the  labels. 
The  weights  are  given  by  the  variable  W.  The  last  row  of  array  STORE  is 
reserved  for  the  no-match  probability  p^  (1*). 

From  the  above  information,  the  starting  row  location  for  storing 
the  weights  in  array  STORE  can  be  determined  as  a  function  of  N.  Since 
the  first  three  and  last  rows  are  used  for  other  information,  N-4  rows 
are  available  for  label  and  weight  storage.  There  are  two  thirds  as 
many  labels  as  weights.  Thus,  since  the  first  three  storage  locations 
are  used,  the  last  label  storage  location  is  row  2(H-4)/3+3. 
Therefore,  the  row  starting  location  of  the  first  weight  is  2(N-4)/3+4. 
Therefore,  2(N-4)/3  labels  and  (N— 4 ) / 3  weights  will  be  stored  in  array 
STORE.  These  values  are,  of  course,  truncated  to  the  corresponding 
integer  value.  Thus,  one  or  more  storage  locations  may  not  be  used, 
depending  on  the  value  of  N.  The  variable  LBLTST  is  assigned  the  value 
of  the  last  label  row  storage  position  to  test  for  an  excessive  number 
of  labels  during  program  execution.  For  N-32,  there  is  space  for  9 


labels  (18  storage  locations)  and  9  weights.  Mote  that  adding  the  4 
additional  locations  required  for  storing  the  other  variables  yields  31 
locations  with  one  location  unused  (this  will  be  row  31).  The  relative 
locations  of  the  variables  stored  in  array  STORE  is  shown  in  Table  V. 

Subroutine  LABELS  begins  by  reading  the  row  and  column  values  for 
the  first  node  from  IP  set  1  file,  and  scores  the  correlation  window  in 
array  IPCW1.  Next,  the  number  of  interesting  points  in  IP  set  2  is 
read  from  IP  set  2  file,  and  the  values  of  the  x  and  y  coordinate 
locations  of  node  Sj  (IPR0W1  and  IPC0L1)  are  placed  in  array  locations 
ST0RE(1,1)  and  ST0RE(2,1)  respectively.  The  disparity  window  is  formed 
around  node  aj  by  adding  and  subtracting  the  values  of  DWDRWH  and 
DWDCLH  to  IPROW1  and  IPC0L1  to  obtain  the  window  boundaries  DRWMIN, 
DRWMAX,  DCLMIN,  and  DCLMAX  as  shown  below: 

DRWMIN 

IPR0W1 

DRWMAX 

Interesting  points  from  IP  set  2  are  now  read  in  successively, 
along  with  their  associated  correlation  windows.  The  x  and  y 
coordinate  values  of  these  points  are  given  by  IPR0W2  and  IPC0L2 
respectively.  The  correlation  window  is  scored  in  array  IPCW2.  The 
interesting  point  row  and  column  locations  of  IP  set  2  are  tested 


DCLMIN  IPC0L1  DCLMAX 


Table  V.  Relative  Locations  of  Labels  and  Weights  in  Array  STORE 


ARRAY  STORE (N,M) 


Variables  Associated 
with  node  i 


Nodes  of  IP  SET  1 


2 


1.  Row  (Xi)  of  I P ( i ) 

2.  Column  (Y-,- 

)  of  IP(i)  1 

3.  Number  of  Labels  (j)  | 

4.  LABELS 

Ixl 

5. 

lyi 

6. 

1x2 

7. 

iy2 

2(N-4)/3+2. 

2(N-4)/3+3 

]yj 

2(N-4)/3+4. 

Ml(l) 

2(N-4)/3+5. 

W2(l) 

‘  WEIGHTS 

2(N-4)/3+(j+3) 

Wjf) 

2(N-4)/3+( j+4) 

• 

N. 

Pi(l*) 

LBLKNT 


LX 

LY 


*  (UNUSED  IF  2(N-4)  NOT  DIVISIBLE  BY  3) 


ffi 


against  the  values  of  DRWMIN,  DRWMAX ,  DCLMIN ,  and  DCLMAX 
to  determine  if  any  of  the  points  lie  within  the  disparity  window.  If 
both  IPR0W2  and  IPC0L2  lie  within  the  bounds  of  these  variables,  that 
interesting  point  becomes  a  candidate  match  point,  and  the  flags  DRWFLG 
and  DCLFLG  are  set  to  1  to  signal  the  program  to  form  a  label  and 
associated  weight  using  this  point.  To  determine  the  weight, subroutine 
CVDEQ8  is  first  called  to  equate  the  correlation  window  sizes,  and  then 
subroutine  W8AFND  is  called  to  obtain  the  weighting  algorithm  specified 
earlier  in  subroutine  W8ASEL.  This  weighting  algorithm  determines  the 
weight  associated  with  the  label  being  formed. 

After  the  weight  has  been  determined,  the  label  associated  with 
the  candidate  match  point  is  formed  by 

LX  -  I PROW 1  -  IPR0W2  (35) 

LY  -  IPC0L1  -  IPC0L2  (36) 

This  label  is  then  stored  in  the  appropriate  row  position  in  STORE,  W 
is  stored  in  its  appropriate  row  position,  and  LBLKNT  is  incremented  by 
1.  When  every  node  from  IP  set  1  has  been  compared  with  every 
interesting  point  from  IP  set  2,  and  the  labels  and  weights  formed  from 
each  candidate  match  point  that  lies  within  the  disparity  window,  then 
the  complete  set  of  labels  and  weights  for  all  the  nodes  has  been 
specified. 

If  there  are  more  candidate  match  points  within  the  disparity 
window  of  a  given  node  than  label  storage  positions,  the  label  storage 
size  of  array  STORE  will  be  exceeded.  This  condition  is  detected  by 
the  variable  LBLTST.  When  this  condition  occurs,  an  advisory  message 


is  displayed  to  the  user,  along  with  the  row  and  column  locations  of 
both  interesting  point  sets  indicating  where  the  condition  occurred. 
The  disparity  window  is  then  reduced  in  size  by  one  pixel  in  each 
direction  by  adding  1  to  DRWMIN  and  DCLMIN  and  subtracting  1  from 
DRWMAX  and  DCLMAX.  The  same  set  of  interesting  points  is  then  again 
compared  with  the  same  node  using  this  smaller  window  size.  If  the 
label  storage  size  is  again  exceeded,  the  disparity  window  is  reduced 
in  size  again,  and  the  same  comparison  sequence  is  repeated.  This 
process  continues  until  the  disparity  window  is  made  small  enough  to 
prevent  the  number  of  labels  from  becomming  excessive,  or  until  the 
disparity  window  reaches  its  minimum  size  (which  is  2x2).  In  either 
case,  processing  then  proceeds  to  the  next  node.  This  technique  of 
successively  reducing  the  window  size  is  called  "adaptive  windowing." 

Equating  Correlation  Window  Sizes.  In  order  to  adequately  compare 
the  correlation  windows  of  the  nodes  from  interesting  point  set  1  and 
the  candidate  match  points  from  interesting  point  set  2  to  determine  a 
weight,  the  intersection  of  these  two  windows  (that  is,  the  points 
which  both  windows  have  in  common)  must  he  determined.  To  make  this 
determination,  subroutine  LABELS  calls  subroutine  CWDEQ8  which  equates 
the  sizes  of  the  two  correlation  windows  from  each  Interesting  point 
based  on  the  value  of  the  orientation  variable  CWTEST.  Eight  different 
cases  are  possible  (the  case  where  the  rows  and  columns  of  both  windows 
are  equal  is  not  needed  since  the  window  sizes  are  already  equated). 
For  example,  consider  the  case  where  the  correlation  windows  of  the 
interesting  points  of  I?  set  1  are  8  X  9  (8  rows  and  9  columns),  and 


the  correlation  windows  of  the  Interesting  points  of  I?  set  2  are  14  X 
4  as  shown  in  Figure  26.  This  is  the  case  where  CWR0W1  is  less  than 
CWR0W2  and  CWC0L1  is  greater  than  CWC0L2.  This  case  would  be  specified 
in  subroutine  CWDEQ8  by  a  value  of  CVTEST  »  4.  Note  that  in  this  case, 
both  correlation  windows  overlap  each  other. 

For  the  case  mentioned  above,  CVDEQ8  first  forms  the  variables 


IRWDIF  -  CWR0W2  -  CWR0W1  (37) 
IRWDFH  *  IRWDIF/2  (38) 
ICLDIF  -  CWC0L1  -  CWC0L2  (39) 
ICLDFH  -  ICLDIF/2  (40) 


Using  these  variables,  the  elements  which  overlap  each  other  in  the  two 
correlation  windows  (which  are  aligned  centered  on  each  interesting 
point)  are  stored  in  the  temporary  arrays  ITMP1  and  ITMP2 .  These 
elements  will  be  the  ones  shown  in  the  shaded  area  of  Figure  26.  The 
other  elements  will  be  discarded.  After  all  the  elements  from  both 
windows  have  been  stored  in  the  temporary  arrays,  they  are  restored  in 
their  original  arrays  IPCW1  and  IPCW2,  and  are  now  of  identical  size. 
Since  the  correlation  windows  are  now  of  identical  size,  and  centered 
about  their  respective  interesting  points,  they  nay  be  directly 
compared  by  the  weighting  algorithms.  The  other  7  cases  are  treated  in 
the  same  manner  as  this  one.  If  the  debug  version  of  program  DIDA  is 
being  executed,  these  new  correlation  windows  are  printed  on  the  line 
printer  after  they  are  formed. 

Weighting  Algorithms.  Once  the  correlation  window  sizes  have  been 


equated  by  subroutine  CWDEQ8  (if  necessary),  subroutine  LABELS  calls 


subroutine  WfiAFND  to  in  turn  call  the  subroutine  associated  with  the 
weighting  algorithm  specified  by  the  user  in  subroutine  W8ASEL.  This 
weighting  algorithm  subroutine  is  called  based  on  the  value  of  W8ANBR 
transferred  by  subroutine  178ASEL.  Note  here  the  formidable  power  of  the 
transferance  principle.  Even  though  the  user  specified  this  algorithm 
much  earlier  in  the  program,  it  is  as  though  it  has  just  been  specified 
as  far  as  the  program  is  concerned. 

Six  weighting  algorithms  nay  be  selected  for  use  in  program  DIDA: 
(1)  sum-of-squares  pixel  differencing;  (2)  average  difference;  (3) 
center-minus-average  difference;  (4)  gradient  difference;  (5)  variance 
difference;  and  (6)  statistical  correlation.  Each  of  these  weighting 
algorithms  is  described  below. 

Sum-of-Squares  Pixel  Differencing.  In  this  weighting  algorithm 
(W8ALGD,  the  difference  of  the  pixels  of  the  correlation  windows  of 
the  two  interesting  points  being  compared  is  obtained.  This  difference 
is  given  by  the  variable  CWNDIF.  The  square  of  this  difference  is  then 
obtained  as  given  by  the  variable  DIFSQR.  The  sum  of  these  squared 
differences  Is  then  obtained  over  the  window  area  as  given  by  the 
variable  SUM.  The  value  of  the  weight,  W,  returned  to  LABELS  is  then 
given  by  equation  (35)  as 

W  «  l.O/U.O  +  C*SUM)  (41) 

where  C  is  the  arbitrary  constant  previously  defined.  This  is  the 
method  of  weighting  used  by  Barnard  and  Thompson  [Ref.  4:  335]. 


Average  Pi f fere nee.  In  this  weighting  algorithm  (W8ALC2),  the  sun 
of  the  elements  of  each  correlation  window  is  obtained.  This  sum  is 
then  used  to  obtain  the  average  by  dividing  by  the  window  size.  The 
sums  are  given  by  the  variables  SUM1  and  SUM2  and  the  corresponding 
averages  are  CWAVE1  and  CWAVE2.  The  absolute  value  of  the  difference 
of  these  two  averages  is  then  used  to  form  the  weight  as  given  by 
equation  (41)  above. 

Center-Minus- Average  Difference.  In  this  weighting  algorithm 
(W8ALG3),  the  sum  of  each  correlation  window  is  formed  as  in  W8ALG2, 
and  the  average  is  obtained.  The  value  of  the  average  of  each  window 
is  then  subtracted  from  the  center  element  of  the  window.  The  absolute 
value  of  the  difference  of  this  result  for  each  window  is  used  to  form 
the  weight  as  given  by  equation  (41). 

Gradient  Difference.  In  this  weighting  algorithm  (W8ALG4),  the 
gradient  of  each  correlation  window  is  obtained  by  first  forming  a 
square  window  from  the  existing  window.  Four  sums  are  then  formed: 
(1)  upper  left  quarter  of  window;  (2)  upper  right  quarter  of  window;  (3) 
lower  left  quarter  of  window;  and  (4)  lower  right  quarter  of  window. 
These  sums  are  specified  for  both  windows  by  the  variables  ASUM1, 
ASUM2,  BSUM1,  BSUM2,  CSUM1,  CSUM2 ,  and  PSUM1,  DSUM2 .  The  variable 
ISQRT  describes  the  new  window  size. 

Next,  four  coordinate  averages  are  formed  by  dividing  the  quadrant 
sums  by  the  number  of  elements  of  that  quadrant.  The  displacement 
between  quadrants  is  given  by 


NOF  -  (ISQRT  +  l)/2  (42) 

and  the  coordinate  differences  for  each  window  are  given  by 


ALPHAl  »  ((Al  +  31)  -  (Cl  +  D1  )/NDF  (43) 

BETAl  -  ((Bl  +  Dl)  -  (Al  +  C1))/NDF  (44) 

ALPHA2  -  ((A2  +  B2)  -  (C2  +  D2))/NDF  (45) 

BETA2  -  ((B2  +  D2)  -  (A2  +  C2))/NDF  (46) 


where  Al,  Bl,  Cl,  and  Dl  are  the  quadrant  averages  for  the  first 
window,  and  A2,  B2,  C2 ,  and  D2  are  the  quadrant  averages  for  the  second 
window.  The  gradients  of  each  window  are  then  given  by 

G1  -  SQRT( ALPHAl  *  ALPHAl  +  BETAl  *  BETAl)  (47) 

G2  -  S0RT(ALPHA2  *  ALPHA2  +  BETA2  *  BETA2)  (48) 

The  absolute  value  of  the  difference  of  these  two  gradients  is  then 

used  to  form  the  weight  as  given  by  equation  (41). 

Variance  Pi fference.  In  this  weighting  algorithm  (W8ALG5),  the 
variance  of  each  correlation  window  is  computed  by  first  forming  the 
sum  and  sura-of-squares  of  the  elements  of  each  window.  These  sums  are 
given  by  the  variables  SUM1,  SUM2,  and  SQRSM1 ,  SQRSM2.  The  means  are 
then  formed  and  given  by  the  variables  CMEAN1  and  CMEAN2.  The  mean 
squares  are  given  by  SQRCM1  and  SQRCM2.  Finally,  the  variances  of  the 
windows  are  given  by 

CWVAR1  -  SQRSM1/CWSZE  -  SQRCM1  (49) 

CWVAR2  -  SQRSM2/CWSZE  -  SQRCM2  (50) 

The  absolute  value  of  the  difference  of  these  variances  (given  by  the 
variable  CVRDIF)  is  then  used  to  form  the  weight  as  given  by  equation 
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(41) 


Statistical  Correlation.  In  this  weighting  algorithm  (W8ALG6),  the 
statistical  correlation  is  detemined  for  the  two  correlation  windows  by 


the  expression  {Ref.  21:  91]. 

-  ‘xv  BllVi-(jiV<Ji^i) 

rxy  -  vHrh  -  i - 


(51) 


where  -1<  r  <  1  is  the  statistical  correlation  coefficient.  Here,  to 

-  Xy  - 

form  the  desired  weight,  W,  we  merely  set  W  -  ABS(r  ).  To  compute  the 

xy 

statlscal  correlation  coefficient,  the  same  sums  and  sums-of-squares 
are  formed  as  in  W8ALG5 ,  except  this  time  the  cross  terms  must  also  be 
included.  These  cross-product  terms  are  given  by  the  variables  CRSPRD 
and  CPSUM.  The  sum  squares  for  each  window  are  given  by  the  variables 
SQRCS1  and  SQRCS2 .  The  covariance  contribution  (numerator  of  equation 
(51))  is  then 


Cl 2  -  CWSZE*CPSUM  -  SUM1*SUM2 


(52) 


and  the  individual  variances  are  given  by 


VI  -  SQRSM1*CWSZE  -  SQRCS1  (53) 

V2  -  SQRSM2*CWSZE  -  SQRCS2  (54) 

Finally,  the  weight  is  given  by 

W  -  ABS  (C12/SQRT(V1*V2) )  (55) 

Initial  Probabilities 
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After  determination  of  the  disparity  labels  and  weights  in 
subroutine  LABELS,  subroutine  MTALG1  calls  subroutine  INPROB  to 
determine  the  initial  label  probabilities  from  the  previously 
determined  weights.  To  begin  with,  INPROB  determines  the  sum  of  the 
weights  and  maximum  weight  for  node  a^,  as  given  by  the  variables  WSUM 
and  UMAX  respectively.  The  no-match  probability  is  then  given  by 
equation  (36)  as  (array  STORE  is  renamed  P  in  this  subroutine) 

P(N,i)  -  1-WMAX  (56) 

The  conditional  probability  is  given  by  equation  (37)  as 

CP ROB  -  P(l,i)/WSUM  (57) 

for  each  label,  1.  Finally,  the  initial  probabilities  for  each  label 
are  determined  from  equations  (56)  and  (57)  as  given  by  equation  (38) 
as 


P(l,i)  -  CPROB*( 1 .0-P(N, i) )  (58) 

If  the  debug  version  of  program  DIDA  is  being  executed,  these 
initial  probabilities,  and  the  no-raatch  probability,  are  printed  on  the 
line  printer. 

Probability  Updates 

Once  the  initial  probabilities  have  been  determined,  they  are 
updated  by  MTALG1  by  calling  subroutines  UDPROB.  Subroutine  UDPROB 
tests  for  nodes  within  the  consistency  neighborhood  defined  by  the 
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variables  NRWMIN,  NRWMAX,  NCLMIN,  and  NCLMAX  in  exactly  the  same 
fashion  as  subroutine  LABELS  tested  for  the  interesting  points  from  IP 
set  2  within  the  disparity  window.  To  begin  with,  the  consistency 
factors  QL(1)  and  QLSTR  are  set  to  zero.  Then,  for  node  the 

variables  NR0W1  «  P(l,i)  and  NC0L1  ■  P(2,i)  are  defined  to  form  the 
consistency  neighborhood  (again,  array  STORE  is  renamed  P  in  this 
subroutine).  Thus,  adding  and  subtracting  the  values  of  NGHRWH  and 
NGHCLH  to  NR0W1  and  NC0L1  forms  the  neighborhood.  As  in  the  case  of 
the  disparity  window,  nodes  a^  are  tested  for  presence  within  the 
neighborhood  formed  by  a^  (note:  jj*i > . 

Next,  UDPROB  forms  the  variables  NR0W2  -  P(l,j)  and  NC0L2  -  P(2,j) 
to  test  for  the  presence  of  node  a^  within  the  consistency 
neighborhood.  If  a  node  is  found  within  this  neighborhood,  the  flags 
NRWFLG  and  NCLFLG  are  set  to  1  to  signal  the  presence  of  this  node  in 
the  neighborhood.  In  this  case,  the  no-match  consistency  property 
QLSTR  is  updated  in  accordance  with  equation  (42)  as 

QLSTR  -  QLSTR  +  P(N, j)  (59) 

After  this,  the  label  differences  between  nodes  a^^  and  a^  are  compared 
in  accordance  with  equation  (39)  as 

LBLRDF-  ABS(P(1X  i)-P(lx  j) )  (60) 

LBLCDF  -  ABS(P(ly’1)-P(ly[j  )  (61) 

Each  of  these  label  differences  is  then  tested  against  the  user-defined 
threshold,  T.  If  LBLRDF  is  less  than  or  equal  to  T,  the  flag  LBRFLG  is 
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set  to  1  to  signal  that  this  difference  is  less  than  or  equal  to  the 
threshold  value.  Similarly,  if  LBLCDF  is  less  than  or  equal  to  T, 
LBCFLG  is  set  to  1.  If  both  flags  are  simultaneously  set  to  1  by  a 
given  label  test,  the  consistency  factor  is  updated  in  accordance  with 
equation  (41)  ac 


QL(1) 


QL( 1 )  +  P(l,j) 


(62) 


The  updated  probabilities  are  next  formed  in  accordance  with  equations 
(43)  and  (44)  as 


P(l,i)  -  P( 1 , i ) * (A+B*QL( 1 ) ) 


(63) 


and  for  1* 


P(N,i)  -  P(N,i)*(A+3*OLSTR) 


(64) 


The  probability  sum  is  also  formed  while  these  probabilities  are  being 
updated  as 


PSUM  -  PSUM  +  P(l,i) 


(65) 


and,  for  1* 


PSUM  -  PSUM  +  P(N,i) 


(66) 


Finally,  the  new  probabilities  (which  are  really  the  updated 
probabilities)  are  formed  in  accordance  with  equations  (45)  and  (46)  as 


P(l,i)  -  P(1 ,  D/PSUM 


(67) 
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and  for  1* 


P(N,i)  -  P(N,i)/?SUM  (68) 

If  the  debug  version  of  program  DIDA  is  being  executed,  these  new 
(updated)  label  probabilities,  along  with  the  new  no-match 
probabilities,  are  listed  on  the  line  printer.  The  iteration  number  is 
also  printed  at  the  beginning  of  the  probability  update. 

Thus,  in  summary,  to  match  interesting  points  selected  on  one 
image  to  those  selected  on  a  second  image  using  the  relaxation-labeling 
matching  algorithm,  a  disparity  window  is  first  formed  by  the  nodes  of 
image  1.  Interesting  points  from  image  2  that  lie  within  this 

disparity  window  are  used  to  fora  labels  by  differencing  their  x-y 

coordinate  values  with  those  of  the  node  that  formed  the  window. 
Weights  are  formed  using  the  correlation  windows  of  the  interesting 
points  from  image  2  within  the  disparity  window  and  the  correlation 
window  of  node  a^  .  These  weights  are  formed  by  an  algorithm  which  the 
user  selects.  Next,  the  initial  probabilities,  and  initial  no-match 
probability,  are  formed  using  the  previously  determined  weights.  These 
probabilities  are  updated  based  on  the  consistency  property  by 

comparing  nodes  within  a  given  neighborhood  of  one  another.  If  these 
nodes  have  similar  labels,  the  consistency  factor  is  increased.  Also, 
the  no-match  consistency  factor  is  updated  for  nodes  which  are 

close-by.  Thus,  if  nodes  within  the  consistency  neighborhood  have  no 
labels  that  are  similar,  the  no-match  consistency  factor  will  Increase, 
but  the  match  consistency  factor  will  not.  However,  if  several  labels 
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within  the  neighborhood  are  similar,  the  match  consistency  factor  will 
increase  more  than  the  no-match  consistency  factor.  Finally,  the 
probability  updates  are  accomplished  using  these  consistency  factors, 
and  the  new  probabilities  are  obtained  by  dividing  these  probability 
updates  by  the  probability  sum  (including  1*).  A  flow ■ diagram 
illustrating  the  relaxation-labeling  notching  algorithm  is  shown  in 
figure  27. 


MTALG1 


Figure  27.  Relaxation-Labeling  Matching  Algorithm  Flow  Diagram 
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V.  Results  and  Conclusions 


During  the  course  of  this  study,  an  interactive  program,  called 
program  DIDA,  was  developed  to  be  used  to  perform  disparity  analysis  of 
time-varying  imagery.  The  program  consists  of  four  major  sections: 
(1)  image  operations;  (2)  interesting  point  selection;  (3)  interesting 
point  matching;  and  (4)  image  display.  Three  data  bases  were  obtained 
and  structured  to  produce  the  proper  format  for  use  by  program  DIDA. 
These  data  bases  are:  (1)  the  NVL  data  base;  (2)  the  UM  data  base;  and 
(3)  the  UH  data  base.  Photographs  of  selected  images  from  each  data 
base  were  obtained.  Also,  photographs  of  selected  images  with 
interesting  points  overwritten  on  them  were  obtained. 

Each  of  the  four  sections  of  program  DIQA  were  tested  to  determine 
the  effectiveness  of  their  operation.  Although  time  did  not  permit  an 
exhaustive  analysis  of  each  section,  representative  operations  from 
each  section  were  performed  to  demonstrate  the  most  useful  features  of 
each  section.  The  results  obtained  from  the  operation  of  each  section 
of  program  DIDA  are  given  below,  along  with  some  concluding  remarks. 

Image  Operations  Results 

Each  of  the  image  operations  permitted  by  the  image  operations 
section  of  program  DIDA  was  successfully  tested.  The  operation  to 
print  image  intensities  on  the  line  printer  is  particularly  useful  for 
checking  the  implementation  of  new  data  bases,  and  determining  the 
threshold  value  to  be  used  for  interesting  point  selection.  By 


printing  out  a  few  rows  of  intensity  values  of  a  newly  implemented  data 
base,  the  correctness  of  the  implementation  can  be  confirmed.  Also,  by 
examining  the  intensity  values  of  selected  portions  of  the  image,  the 
variances  can  be  approximated  to  determine  an  appropriate  threshold  to 
use  to  restrict  the  number  of  interesting  points  selected  to  a 
reasonable  number. 

The  image  creation  and  deletion  operations  can  be  used  to  test  new 
interest  operators  and  matching  algorithms  for  correct  operation  before 
attempting  to  use  them  on  large  images.  Using  one  of  the  image 
creation  algorthims,  a  small  test  image  can  be  created.  Then,  another 
snail  image  can  be  created  which  is  similar  to  the  first  one.  The  new 
interest  operator  is  applied  independently  to  both  images  to  select 
interesting  points.  The  new  matching  algorithm  is  used  to  attempt  to 
match  these  selected  points.  During  these  operations,  the  debug 
version  of  the  program  is  exercised  to  print  out  the  intermediate 
processing  steps  during  program  execution.  An  analysis  of  the  debug 
listing  may  then  be  used  to  determine  errors  in  the  interest  operator 
algorithm,  and  the  matching  algorithm. 

The  debug  version  of  program  DIDA  is  exactly  identical  to  the 
non-debug  version.  This  version  is  called  DIDAD,  and  prints  out  many 
intermediate  computations  performed  during  interesting  point  selection 
and  matching  that  are  not  printed  during  the  execution  of  the  non-dehug 
program  version.  This  debug  output  is  produced  by  placing  a  "D"  in 
column  one  of  the  FORTRAN  code  line.  At  compile  time,  when  the 
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compiler  "sees"  this  D  in  the  first  column,  it  is  ignored  unless  the 
/DE  switch  has  been  specified.  If  this  switch  is  specified,  the 
compiler  does  not  ignore  the  statements  with  a  "D"  in  column  one,  and 
these  statements  are  executed  when  the  program  is  run.  Thus,  two 
program  versions  were  compiled;  one  with  the  /DE  switch  specified 
(DIQAD)  to  produce  the  debug  version,  and  another  without  this  switch 
specified  (DIDA)  to  produce  a  non-debug  version. 

After  the  new  Interest  operator  has  been  tested  using  the  debug 
program  version  on  a  small,  test  image,  or  a  new  matching  algorithm  has 
been  tested  on  two  or  more  small  test  images,  any  errors  which  appear 
can  be  corrected  using  the  debug  listing.  The  non-debug  version  of  the 
program  may  then  be  executed  on  much  larger  linages  to  obtain  meaningful 
results.  When  they  are  no  longer  needed,  the  small  test  images  can  be 
deleted  using  the  image  deletion  operation. 

Interest  Ope rator  Results 

Each  of  the  Interest  operators  implemented  in  program  DIDA  were 
tested  for  correct  operation  using  the  debug  version  of  the  program,  as 
mentioned  above.  These  operators  were  then  applied  to  two  of  the 
images  from  the  UM  data  base  for  various  threshold  values.  It  was 
found  that  the  number  of  interesting  points  selected  is  inversely 
proportional  to  the  threshold  value  specified.  This  is  to  be  expected 
since  there  will  be,  in  general,  many  more  points  with  low  variance 
values  than  points  with  high  values.  Thus,  for  high  threshold  values, 
only  a  few  variance  values  should  exceed  this  threshold  and  become 
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interesting  points.  Conversely,  for  low  threshold  values,  many 
interesting  points  should  be  selected. 

Another  result  observed  was  that  the  threshold  value  required  to 
produce  the  same  number  of  interesting  points  varied  for  each  of  the 
three  different  interest  operators.  In  general,  a  lower  threshold 
value  was  required  for  the  directed  variance  and  edged  variance 
interest  operators  than  for  the  simple  variance  operator  to  produce  the 
same  number  of  interesting  points.  The  effect  of  changing  the 
threshold  value  on  the  number  of  interesting  points  produced  for  two 
different  image  pairs  from  the  UM  data  base  is  shown  in  Table  VI.  The 
interest  operators  included  in  this  table,  according  to  their  number, 
are: 

I0P#1  *  Simple  Variance  Operator 
I0P*2  ■  Directed  Variance  Operator 
I0P#3  -  Edged  Variance  Operator 

Matching  Algorithm  Results 

The  relaxation-labeling  matching  algorithm  implemented  in  program 
DIDA  (MTALGI )  was  tested  for  correct  operation  using  the  debug  version 
of  the  program,  as  mentioned  above.  This  algorithm  was  difficult  to 
adequately  test  due  to  a  lack  of  sufficiently  similar  test  images. 
When  tested  on  larger  images  using  the  non-debug  program  version,  very 
poor  matching  efficiencies  were  observed.  The  constants  for  the 
matching  algorithm  suggested  by  Thompson  [Ref.  4:336]  were  used 
throughout  the  test.  In  every  test  conducted,  very  low  matching 


Table  VI .  Effect  of  Changing  the  Variance  Threshol d  on  the 
Number  of  Interesting  Points  Produced. 
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efficiencies  were  observed  (most  were  zero).  The  matching  efficiencies 
of  various  interesting  point  sets  obtained  using  the  three  interest 
operators  of  program  DIDA  are  shown  in  Table  VII  (also  refer  to  Table 
VI).  It  is  believed  that  a  more  judicious  selection  of  the  parameters 
associated  with  the  matching  algorithm  would  produce  much-  better 
results. 

Image  Display  Results 

Each  of  the  image  display  options  permitted  by  the  image  display 
section  of  the  program  DIDA  was  successfully  tested.  The  blow-up 
feature  worked  well,  but  produced  images  that  were  somewhat  distorted. 
The  main  source  of  distortion  resulted  from  a  "stairstep"  effect  along 
diagonal  edges  within  the  scene.  This  stairstep  phenomena  resulted 
from  the  fact  that  when  the  image  is  blown-up,  each  pixel  is  reproduced 
in  an  area  surrounding  itself  the  appropriate  number  of  times  to 
produce  a  512x512  image  (16  times  for  a  128x128  image). 

Also,  the  colored  images  produced  were  not  natural  color.  No 
pre-written  algorithm  was  available  with  the  RAMTEK  driver  to  produce 
natural  color  images  from  a  set  of  intensity  values.  Thus,  the  colors 
assigned  to  ranges  of  intensities  were  selected  on  a  trial-and-error 
basis.  The  resulting  colored  images  were  more  of  a  "pseudo-color"  than 
naturally  colored. 

To  illustrate  the  results  of  the  interest  operators,  a  number  of 
photographs  were  taken  of  the  two  images  from  the  UM  data  base 
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Efficiencies  Obtained  from  Various  Interesting  Point  Sets 


mentioned  above.  To  begin  with,  a  photograph  of  one  of  the  images  was 
taken  in  its  normal  size  (128x128).  The  interesting  points  obtained 
from  interest  operator  2  were  then  written  over  the  image,  and  it  was 
photographed  again.  Next,  the  same  image  was  blown  up  to  512x512  and 
photographed.  Again,  the  interesting  points  were  overwritten. and  the 
image  was  photographed.  This  sequence  of  photographs  was  obtained  to 
illustrate  how  much  easier  it  is  to  examine  the  interest  operator 
results  on  large  image  as  opposed  to  a  much  smaller  one.  These 
photographs  are  shown  in  Figures  28,  29,  30,  and  31  respectively. 

Figures  32  and  33  show  photographs  of  the  same  hlown-up  image  with  the 
results  of  interest  operators  1  and  3  respectively  overwritten. 

A  similar  sequence  was  photographed  for  a  different  image  as  shown 
in  Figures  34,  35,  36,  and  37.  Figure  38  shows  the  same  image  for  a 

smaller  number  of  interesting  points  (same  interest  operator  using  a 
higher  threshold).  Finally,  photographs  of  one  of  the  images  from  the 
UH  data  base  and  the  NVL  data  base  are  shown  in  Figures  39  and  40 
respectively.  A  summary  of  these  photographs  is  given  in  Table  VIII. 

Conclusions 

Although  the  results  from  the  interest  operators  of  program  DIDA 
demonstrate  an  operational  capability  for  interesting  point  selection, 
much  work  is  still  necessary  before  a  full-scale  real-time  disparity 
analysis  program  can  be  realized.  To  begin  with,  the  speed  at  which 
the  interest  operators  execute  must  be  greatly  reduced.  Typical 
processing  times  varied  from  approximately  15  minutes  for  a  128  xI28 
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Figure  29.  Truck  Image  (128x128)  with  284  Interest Ing  Points  Overwritten 
(TRUCK.  IMG;  2)  using  the  Moravec  Interest  Operator  ( 1 0P//2) 
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Figure  40.  Image  of  a  Section  of  the  Night  Vision  Lab  Terrain 


image  to  almost  4  hours  for  a  512x512  image  for  the  Moravec  Operator 
(I0P#2).  This  time  was  about  the  same  for  the  simple  variance 
operator,  and  almost  double  for  the  edged  variance  operator. 

Next,  problems  associated  with  the  matching  algorithm  must  also  be 
resolved.  The  matching  efficiencies  obtained  during  this  study  could 
not  even  begin  to  produce  satisfactory  results  for  target  tracking  and 
other  similar  operations.  As  in  the  case  of  the  interest  operators, 
the  processing  speed  of  the  natching  algorithm  must  also  be  increased 
before  a  real-time  program  can  be  obtained.  Processing  times  for 
matching  two  128x128  images  averaged  5  to  7  minutes.  Matching  of  two 
512x512  images  was  not  attempted. 

Finally,  an  integrated  system  must  be  developed  to  Incorporate  the 
features  of  the  DIDA  program  into  the  DIPS  system  to  provide  a 
completely  flexible  analytical  tool  to  perform  real-time  disparity 
analysis  operations,  and  make  modifications  to  the  appropriate  program 
parameters  as  the  need  arises.  In  its  completed  form,  the  DIPS 
processing  system  should  allow  the  user  to  manipulate  image  data  files 
or  modify  them  as  the  need  arises,  perform  image  smoothing,  and 
accomplish  real-time  disparity  analysis  of  time-varying  imagery. 


VI.  Recommendations  for  Further  Study 


The  following  recommendations  for  further  study  are  suggested  for 
each  section  of  program  DIDA.  Following  these  recommendations,  some 
general  recommendations  pertaining  to  the  overall  effort  are  given. 


Image  Operations  Reconme ndatlons 

The  following  recommendations  for  further  study  are  suggested  for 
the  image  operations  section  of  program  DIDA: 

1.  An  option  to  allow  the  user  to  change  single  intensity 
elements  within  a  given  image. 

2.  An  option  to  allow  the  user  to  perform  image  operations  on  a 
magnetic  tape  file  as  well  as  a  disk  file. 

3.  An  option  to  allow  the  user  to  transfer  image  files  from 
disk  to  magnetic  tape,  or  from  magnetic  tape  to  disk. 

Interest  Operator  Recommendations 


The  following  recommendations  for  further  study  are  suggested  for 
the  interesting  point  selection  section  of  program  DIDA: 

1.  A  method  for  inputting  sub-images  and  locating  interesting 
points  on  them.  This  entails  bringing  in  only  a  portion  of 
a  complete  image  file  into  the  program  for  processing, 
thereby  allowing  the  user  to  look  at  a  certain  selected  area 
of  the  image  for  interesting  points.  This  would  he 
particularly  useful  if  the  interesting  points  of  only  a 
certain  image  feature  (such  as  a  tank)  were  desired. 

2.  A  method  for  moving  the  processing  window  over  the  image  in 
a  non-sequential  fashion.  A  search  pattern  other  than 
left-to-right,  top-to-bottora  may  be  desired  for  some  reason. 

For  instance,  a  non-sequential  window  mov- ment  might  be 
desired  for  studying  the  manner  in  which  a  human  views  a 
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3.  An  adaptive  threshold  to  select  interesting  points  in  lieu 
of  being  set  by  the  user.  This  could  be  accomplished  by 
first  finding  the  variance  over  the  entire  image,  then, 
modifying  that  variance  based  on  the  nunber  of  interesting 
points  desired  to  produce  the  appropriate  threshold. 

4.  An  interest  operator  using  binary  images  (i.e.,  images 
represented  by  only  ones  and  zeros). 

5.  An  interest  operator  using  a  blob  detection  algorithm. 


6.  An  interest  operator  using  "micro-texture". 
2x2  window  shown  below: 


Consider  the 


Define  the  following  quantities 


4to 

=  a+b+c+d 

(69) 

4cx 

•  -a+b-c+d 

(70) 

4ty 

»  a+b-c-d 

(71) 

*1 

=*  -a+b-c+d 

(72) 

In  the  above  expressions,  tQ  corresponds  to  the  average  over 
the  window,  tx  and  ty  are  gradient  vectors,  and  t  is  an 
operator  similar  in  function  to  a  2nd  derivative  operation. 
Testing  for  t  greater  than  some  specified  threshold 
produces  the  interest  operator.  For  areas  larger  than  2x2, 
a  Hadamard  Transform  may  be  employed  to  look  at  functions  of 


the  combinations  of  t 


and  t_  for  each  2x2  window. 


7.  Interesting  points  should  be  selected  for  varying  processing 
window  sizes  to  determine  the  effect  of  window  size  on 
placement  of  interesting  points  on  the  image  being 
processed. 

8.  Various  values  of  epsilon  should  be  tried  for  the  maximum 
directed  variance  tests  for  interest  operator  # 2  to 
determine  their  effect  on  interesting  point  selection. 
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Matching  Algorithm  Recommendations 

The  following  recommendations  for  further  study  are  suggested  for 
the  interesting  point  matching  section  of  program  DIDA. 


1.  A  method  of  accurately  determining  natched  points  after 
matching  is  complete.  At  the  end  of  the  matching  process,  a 
list  of  the  points  in  interesting  point  set  1  and  their 
corresponding  matching  point  in  interesting  point  set  2  is 
given.  A  method  is  needed  for  verifying  the  accuracy  of 
these  matches. 

2.  A  means  for  treating  ambiguous  nodes.  When  the  matching 
process  is  complete,  some  nodes  may  have  several  labels  with 
finite  non-zero  probabilities.  It  may  be  possible  to 
examine  these  ambiguous  nodes  to  more  accurately  determine 
if  a  match  exists. 

3.  A  set  of  criteria  for  matching.  In  this  effort,  the 
matching  efficiency  was  defined  as  the  the  ratio  of  the 
number  of  matched  to  unmatched  points  expressed  as  a 
percentage.  This  did  not  account  for  points  which  were 
incorrectly  matched,  or  ambiguous  nodes.  A  way  of 
accurately  defining  the  matching  efficiency  of  each  interest 
operator,  as  well  as  other  pertinent  matching  parameters, 
should  be  described. 

4.  The  effect  of  correlation  window  size  on  initial 
probabilities.  Correlation  windows  of  various  sizes  (not 
necessary  equal)  should  be  tried  to  determine  their  effect 
on  the  initial  probabilities  computed  from  them  for  each  of 
the  six  weighting  algorithms. 

5.  The  effect  of  the  weighting  algorithm  parameter,  C,  on  the 
initial  probabilities.  For  the  same  correlation  window  size 
each  time,  the  parameter,  C,  in  each  of  the  weighting 
algorithms  should  be  varied  to  determine  its  effect  on  the 
initial  probabilities  computed. 

6.  Test  weighting  algorithms  for  rotational  invariance.  With 
the  two  images  rotated  with  respect  to  one  another,  the 
ability  of  each  weighting  algorithm  to  assign  meaningful 
initial  probabilities  should  be  assessed  for  various  angles 
of  rotation. 

7.  Describe  weighting  algorithms  which  are  rotationally 

invariant,  and  produce  a  better  set  of  initial 
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probabilities.  The  possibility  of  using  Fourier  Transforms, 
Horev  filtering,  and  other  similar  operations  should  be 
examined . 

8.  The  effect  of  the  size  of  the  consistency  neighborhood  on 
the  number  of  points  that  are  matched. 

9.  The  incorporation  of  a  coefficient  in  the  consistency  factor 
equations  (equations  (41)  and  (42))  to  account  for  the 
distance  between  nodes  within  the  consistency  neighborhood . 
In  this  study,  this  coefficient  was  1  for  all  nodes  within 
the  neighborhood.  However,  in  general,  equations  (41)  and 
(42)  can  be  written  as 


q,k  (1) 


Z 

a  .nea  • 


1 1-1*  1  |  <  T  rij  Pj 


(I')}  (1*1*)  (73) 


and,  for  1* 


q,k(l*)=  Z  r..  p.k(l*)  (74) 

a  near  a.  J 

J  j*i 

In  the  above  equations,  is  the  coefficient  which  relates 
the  distance  between  nodes  within  the  consistency 
neighborhood  to  the  consistency  factor,  q.  One  possible 
assessment  of  r^j  might  be 

rij  =  C(xi "  xj)2  +  (y i  -  (75) 


10.  The  effect  of  changes  of  the  similarity  parameter,  T,  on  the 

consistency  factor,  q.  This  should  also  be  related  to  the 

resulting  matching  efficiency. 

11.  The  effect  of  changes  of  the  parameters  A  and  B  on  the 

probability  updates.  Each  parameter  should  be  varied 

Independently,  and  the  resulting  updated  probabilities 
noted. 


Image  Display  Recomraenda t ions 


MICROCOPY  RESOLUTION  TEST  CHART 

NATIONAL  BUREAU  Of  STANDARDS- 1 963- A 


The  following  recommendations  for  further  study  are  suggested  for 
the  image  display  section  of  program  DIDA. 

1.  An  inverse  image  capability  for  displaying  both  normal 
images  and  their  negatives. 

2.  A  method  for  displaying  images  in  their  natural  color. 

3.  A  method  for  writing  text  on  or  below  a  displayed  image. 

4.  An  option  for  interactively  changing  the  video  look-up  table 
of  the  RAMTEK  driver  to  produce  "pseudo-color"  images  with  a 
user-specified  color  versus  intensity  distribution. 

5.  A  method  for  overwriting  the  interesting  points  on  a 

displayed  Image  in  different  colors  based  on  the 

corresponding  interest  operator.  For  instance,  interesting 
points  selected  using  interest  operator  #  1  could  be 
overwritten  in  green,  those  from  interest  operator  #2  in 
blue,  and  those  from  interest  operator  #3  in  red.  Those 
interesting  points  which  overlap  will  then  be  displayed  in  a 
different  color  depending  on  which  points  are  overlaid. 

6.  A  method  of  displaying  split-screen  images  for  comparing  the 
results  of  the  matching  algorithm. 


General  Recommendations 


The  following  recommendations  for  further  study  are  Suggested  for 
the  improvement  of  the  overall  structure  of  program  DIDA. 

1.  A  method  for  processing  the  entire  image  at  one  time. 
Having  access  to  the  entire  image  in  memory  all  at  one  time 
greatly  enhances  both  processing  speed  and  flexibility  of 
processing  operations.  For  instance,  it  would  be  extremely 
difficult  to  employ  a  non-sequential  processing  window 
movement  when  the  image  must  be  buffered  into  core  memory 
several  rows  at  a  time. 

2.  The  use  of  array  processors  to  increase  processing  speed. 

3.  Rewriting  the  program  in  assembly  language  to  increase 
processing  speed. 


Integration  of  program  DIDA  into  the  DIPS  program. 

Development  of  a  real-time  display  algorithm  to  demonstrate 
the  real-time  disparity  analysis  algorithm. 
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Appendix  A:  Glossary  of  Symbols,  Variables,  and  Arrays 


NAME 

ASSOCIATED 
BLOCK  COMMON 

BRIEF  DESCRIPTION  OF  FUNCTION 

IMCROW 

/IMAGE/ 

Number  of  image  rows 

IMGCOL 

Number  of  image  columns 

IMGSZE 

Product  of  Image  rows  and  columns 

1MGINV 

Reciprocal  of  image  size 

LUN 

/FILE / 

Logical  unit  number  associated  with  image 
file 

NCHAft 

Number  of  characters  in  file  name 

FNAME(34) 

Device/UIC/fllenarae  of  image  file 

IOBUFR(L.M) 

/BUF/ 

Buffer  byte  data  to/ from  image  file 

INTBUF(M) 

/INBUF/ 

Store  converted  byte  data  in  16-bit  word 

WNDROW 

/WINDOW/ 

Number  of  window  rows 

WNDCOL 

Number  of  window  columns 

WNDRWH 

WNDROW/ 2 

WNDCLH 

WNDCOL/ 2 

WNDSZE 

Product  of  window  rows  and  columns 

WNDINV 

Reciprocal  of  window  size 

STORE(N.M) 

- 

VIRTUAL  generic  storage  array 

CWDROW 

/CORWND/ 

Number  of  correlation  window  rows 

CWDCOL 

Number  of  correlation  window  columns 

CWDRWH 

CWDR0W/2+I 

CWDCLH 

CWDCOL/ 2+1 

CWDSZE 

Product  of  correlation  window  rows  and 
column 

CWDINV 

Reciprocal  of  correlation  window  size 

IOPNBR 

/IOP/ 

Number  of  Interest  operator  used 

IPFLAG 

Interesting  point  storage  flag 

LUNCW 

/CWFILE/ 

Logical  unit  number  of  correlation  window 
with  scratch  file 

LUN1 

/IFILE1/ 

Logical  unit  number  associated  with 
interesting  point  set  file 

NCHAR1 

Number  of  characters  in  file  name 

FNAMEl(34) 

Device  /UIC/  filename  of  Interesting  point 
set  file 

IPKNT 

/IPS/ 

Number  of  Interesting  points  selected 

IPR(M) 

Array  of  interesting  point  image  row 
locations 

IPC(M) 

Array  of  interesting  point  image  column 
locations 

VALUIP(M) 

Value  of  each  Interesting  point  selected 

IPCWND(M/3) 

Buffer  array  for  correlation  window  storage 
and  retrieval 

IPKNT1 

/IPS1/ 

Number  of  interesting  points  in  first  set 

to  be  marched. 

Interest  operator  used  Co  select  interesting 


IPTYP1 


CWROWl 

points 

Number  of  rows  of  I9  correlation  windows 

CWC0L1 

Number  of  columns  of  IP  correlation  windows 

CWSZE1 

Product  of  correlation  window  rows  and 

LUN2 

/IFILF.2/ 

columns 

Logical  unit  number  associated  with  second 

NCHAR2 

interesting  point  set  file 

Number  of  characters  in  file  name 

FNAMF.2(34) 

Device  /UIC/  filename  of  interesting  point 

IPKNT2 

/IPS2/ 

set  file 

Number  of  interesting  points  in  second  set 

IPTYP2 

to  be  matched 

Interest  operator  used  to  select  interesting 

CWR0W2 

points 

Number  of  rows  of  IP  correlation  windows 

CWC0L2 

Number  of  columns  of  IP  correlation  windows 

CWSZE2 

Product  of  correlation  window  rows  and 

THRESH 

columns 

Variance  threshold  for  interesting  point 

tests 

-  Value  of  simple  variance  computed  in  I0P1 

/MEAN/  Sum  of  intensity  elements  for  window  position 

Suns  of  squares  of  intensities  over  window 
Value  of  mean  computed  in  MEANFD 

-  Fnd-of- image  flag  set  in  WNDMOV 

/MOVE/  Top  row  of  window  WRT  image 

Left  column  of  window  WRT  image 
Bottom  of  window  WRT  image 
Right  column  of  window  WRT  image 
/REG1/  Intensity  element  partial  sums 

Partial  sums  of  squares  of  intensity  elements 
/COUNT/  Intensity  array  row  change  pointer 

Input  buffer  array  row  change  pointer 
Value  of  current  record  being  processed 

-  Row  location  of  each  Interesting  point 

-  Column  location  of  each  interesting  point 

-  Value  of  each  interesting  point 

-  Variable  to  test  for  left  column  of  image 

-  Variable  to  test  for  top  row  of  image 

-  Variable  to  test  for  right  column  of  image 

-  Variable  to  test  for  bottom  row  of  image 

-  Correlation  window  column  starting  position 

-  Correlation  window  row  starting  position 

-  Correlation  window  column  end  position 

-  Correlation  window  row  end  position 

-  Initial  value  of  correlation  window  element 

-  Relative  location  of  image  data  in  input 
records 

IBUF(M)  /BUF/  Correlation  window  record  input  buffer 

EPSLON  /DSTOR/  Maximum  directed  variance  test  threshold 


VARNCE 

COLSUM 

SQRSUM 

MEAN 

IMGEND 

ROWKNT 

CO LENT 

ROWDIF 

COLDIF 

S(M) 

T(M) 

WNDKNT 

BUFKNT 

RECNUM 

IPROW 

IPCOL 

VALUE 

CWDLCL 

CWDTRW 

CWDRCL 

CWDBRW 

CWDCLS 

CWDRWS 

CWDCLE 

CWDRWE 

IPCKNT 

IMCLST 


DCOL 

0(2, M) 

XSUM 

YSUM 

ASUM 

BSUM 

X(M) 

Y(M) 

A(M) 

B(M) 

D1FROW 

DIFCOL 

DIFULD 

DIFLUD 

DFSORW 

DFSQCL 

DFSQUL 

DFSQLU 

DFCLED 

DFSQCE 

DVAR1 

DVAR2 

DVAR3 

DVAR4 

DIRVAR 

EIXIVAR 

EFLAG 

RTOMIN 

RATIO 1 

RATI02 

RATI 03 

RAT 104 

DVDROW 

DWDCOL 

DWDRWH 

DWDCLH 

DWDSZE 

DWDINV 

CWTEST 

W8ANBR 

C 

NGHRCW 

NGHCOL 

NGHRWH 

NGHCLH 

NGHSZE 

NGHINV 

A 


/DRVAR/ 


/RE02 / 


/EDVAR/ 


/DSPWND/ 


/NBHOOD/ 


dumber  of  directed  variance  values  per  D  row. 

Storage  array  for  directed  variance  values 

Sum  of  row  squared  intensity  differences 

Sum  of  column  squared  intensity  differences 

Upper-to-lower  diagonal  sura 

Lower-to-upper  diagonal  sura 

Partial  suras  of  row  squared  differences 

Partial  suns  of  columns  squared  differences 

Upper-to-lower  diagonal  partial  sums 

Lower-to-upper  diagonal  partial  sums 

Elemental  row  difference 

Elemental  column  difference 

Upper-to-lower  diagonal  difference 

Lower-to-upper  diagonal  difference 

DIFROW/2 

DIFCOL/2 

DIFULD/2 

DIFLUn/2 

Difference  of  last  column  intensities 
DFCLED/2 

Row  directional  variance 

Column  directional  variance 

Upper-to-lower  diagonal  directional  variance 

Lower-to-upper  diagonal  directional  variance 

Overall  directed  variance  value 

Edged  variance  value 

Edged  variance  flag 

Minimum  of  directional  variance  ratios 

Ratio  of  DVAR1  to  DVAR2 

Ratio  of  DVAR2  to  DVAR1 

Ratio  of  DVAR3  to  DVAR2 

Ratio  of  DVAR4  to  DVAR3 

Nunber  of  disparity  window  rows 

Number  of  disparity  window  columns 

DWDROW/2 

0WDC0L/2 

Product  of  disparity  window  rows  and  columns 
Reciprocal  of  disparity  window  size 
Specifies  the  orientation  of  the  correlation 
windows 

Number  of  weighting  algorithm  selected 
Arbitrary  constant  used  In  weighting 
algorithms 

Number  of  consistency  neighborhood  rows 
Number  of  consistency  neighborhood  columns 
NGHROW/2 
NGHCOL/ 2 

Product  of  neighborhood  rows  and  columns 
Reciprocal  of  neighborhood  size 
Damping  parameter  for  consistency  factor 
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B 

- 

Gain  parameter  for  consistency  factor 

T 

- 

Label  consistency  threshold 

LBLTST 

- 

Maximum  label  storage  position 

IPR0W1 

- 

X  locations  of  Interesting  point  set  1 

IPCOLI 

- 

Y  locations  of  interesting  point  set  1 

LX 

- 

X  disparity  label  value 

LY 

- 

Y  disparity  label  value 

W 

- 

Weight  returned  by  weighting  algorithm 

LBLKNT 

- 

Number  of  labels 

IPROW2 

- 

X  locations  of  Interesting  point  set  2 

IPCOL2 

- 

Y  locations  of  interesting  point  set  2 

DRV7FLG 

- 

Disparity  window  row  flag 

DCLFLG 

- 

Disparity  window  column  flag 

DRW  MIN 

- 

Lower  bound  on  disparity  window  row 

DRWMAX 

- 

Upper  bound  on  disparity  window  row 

DCLMIN 

- 

Lower  bound  on  disparity  window  column 

DCLMAX 

- 

Upper  bound  on  disparity  window  column 

IRWDIF 

- 

Row  difference  of  correlation  windows 

IRWDFH 

- 

IRWDIF/2 

ICLDIF 

- 

Column  difference  of  correlation  windows 

ICLDFH 

- 

ICLDIF/2 

IPCWl(M/3) 

/REG/ 

Correlation  window  storage  for  IP  set  1 

IPCW2(M/3) 

Correlation  window  storage  for  IP  set  2 

ITMP1 (M/3) 

/REG2 / 

Temporary  correlation  window  storage  for  IP 

set  1 

ITMP2 (M/ 3 ) 

Temporary  correlation  window  storage  for  IP 

set  2 

CWNDIF 

- 

Difference  of  correlation  window  pixels 

DIFSQR 

CWNDIF/2 

SUM 

- 

Sum  of  DIFSQR  over  window  area 

SUM1 

- 

Sum  of  elements  of  correlation  window  1 

SUM2 

- 

Sum  of  elements  of  correlation  window  2 

CWAVE1 

- 

Average  of  SUMl 

CWAVE2 

- 

Average  of  SUM2 

ASUM1 

- 

Upper  left  coordinate  sum  for  window  1 

BSUM1 

~ 

Upper  right  coordinate  sum  for  window  I 

CSUM1 

- 

Lower  left  coordinate  sum  for  window  1 

DSUM1 

- 

Lower  right  cordinate  sum  for  window  1 

ASUM2 

- 

Upper  left  coordinate  sum  for  window  2 

BSUM2 

- 

Upper  right  coordinate  sum  for  window  2 

CSUM2 

- 

Lower  left  coordinate  sum  for  window  2 

DSUM2 

- 

Lower  right  coordinate  sum  for  window  2 

A1 

- 

Average  of  ASUM1 

B1 

- 

Average  of  3SUM1 

Cl 

- 

Average  of  CSUM1 

D1 

- 

Average  of  DSUM1 

A2 

- 

Average  of  ASUM2 

B2 

- 

Average  of  BSUM2 

C2 

- 

Average  of  CSUM2 

02 

- 

Average  of  DSUM2 

NDF 

Cl 

G2 

ISQRT 

SQRSMl 

SQRSM2 

CMEANl 

CMEAK2 

SQRCM1 

SQRCM2 

CWVAR1 

CWVAR2 

CVRD  IF 

CRSPRD 

CPSUM 

SQRCS1 

SQRCS2 

C12 

VI 

V2 

WSUM 

WMAX 

CPROB 

NRWMIN 

NRW.'tAX 

NCLMIN 

NCLMAX 

NRCW1 

NCOL1 

NROW2 

NCOL2 

QL(1) 

QLSTR 

NRWFLG 

NCLFLG 

LBLRDF 

LBLCDF 

LBRFLG 

LBCFLG 

PSUM 

LUNRM 

IPAR(6) 

IOSTAT(2) 

IVLT(256) 

IMBUF(M) 

ICOLOR 


/RBUFF/ 


Displacement  between  coordinate  sums 
Gradient  of  correlation  window  1 
Gradient  of  correlation  window  2 
Size  parameter  of  window  in  W8ALG4 
Sum-o f -squares  of  correlation  window  1 
Sum-of-squares  of  correlation  window  2 
Mean  of  correlation  window  1 
Mean  of  correlation  window  2 
Square  of  mean  of  correlation  window  1 
Square  of  oean  of  correlation  window '2 
Variance  of  correlation  window  1 
Variance  of  correlation  window  2 
Difference  of  variances  of  correlation 
windows 

Product  of  cross  terms  of  correlation 
windows 

Sud  of  cross  products 

Square  of  sums  for  correlation  window  1 
Square  of  sums  for  correlation  window  2 
Covariance  of  both  correlation  windows 
Variance  of  correlation  window  1 
Variance  of  correlation  window  2 
Sum  of  weights  for  each  node 
Maximum  weight  of  each  node 
Conditional  probability  of  a  label  of  ai 
Lower  bond  on  consistency  neighborhood  rows 
Upper  bond  on  consistency  neighborhood  rows 
Lower  bond  on  consistency  neighborhood 
columns 

Upper  bond  on  consistency  neighborhood 
columns 

Row  coordinate  of  node  ai 

Column  coordinate  of  node  ai 

Row  coordinate  of  node  aj 

Column  coordinate  of  node  aj 

Match  consistency  factor  for  label  1 

Ho-raatch  consistency  factor 

Neighborhood  row  flag 

Neighborhood  column  flag 

Label  row  difference 

Label  column  difference 

Label  row  flag 

Label  column  flag 

Sum  of  updated  probabilities 

Logical  unit  number  of  RAMTEK  driver 

Initialization  of  RAMTEK  driver 

Initialization  of  RAMTEK  driver 

RAMTEK  video  look-up  table 

Buffer  array  for  RAMTEK  driver 

Color  flag  for  image  displays 
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ISCALE 


Scaling  flag  for  Image  displays 
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Appendix  JJ :  DIDA  Control  Program 

This  appendix  contains  the  FORTRAN  source  listing  for  the  main 
program  of  program  DIDA. 


PROGRAM  DIDA 
C 

C  PROGRAM  DIDA  CONTROLS  THE  OPERATION  OF  THE  DYNAMIC  IMAGE 

C  DISPARITY  ANALYSIS  ROUTINES.  THE  USER  IS  ASKED  TO  SELECT 

C  THE  DESIRED  OPERATION.  THE  SUBROUTINES  REQUIRED  TO 

C  PERFORM  THAT  OPERATION  ARE  THEN  CALLED.  AFTER  PROCESSING 

C  IS  COMPLETE,  THE  USER  IS  ASKED  TO  EITHER  CONTINUE  PROGRAM 

C  EXECUTION,  OR  TERMINATE. 

C 

C  ***  COMMON  BLOCKS  AND  INITIALIZATION  *** 

C 

INCLUDE  ' COMMON. FTN' 

***  VIRTUAL  STORAGE  AREA  *** 

VIRTUAL  STORE(N.M) 

***  BUFFER  AREA  *** 


COMMON  /IBUF/  IBUF<M) 

COMMON  /BUF/  IOBHFR(L.M) 

COMMON  /INBUF/  INTBUF(M) 

***  REGISTER  AREA  *** 

COMMON  /REG1/  S(M),T(M) 

COMMON  /REG2/  X(M) , Y(M) ,A(M) , B(M) 


***  FILE  AREA  *** 


COMMON  /CWFILE/  LUNCW 

COMMON  /FILE/  LUN , NCHAR, FNAME ( 34 ) 

COMMON  /IFILE1 /  LUN1 ,NCHAR1 , FNAME 1 (34) 

COMMON  /IFILE2/  LUN2 , NCHAR2 , FNAME2 ( 34 ) 

***  INTERESTING  POINT  SET  STORAGE  AREA  *** 

COMMON  /IPS/  IPKNT,IPR(M),IPC(M),VALUIP(>l),IPWND(M/3) 
COMMON  /IPS1/  IPKNT1 ,  IPTYP1  ,CWROWl  ,CWCOLl ,  CV7SZE1 
COMMON  /IPS2/  IPKNT2,IPTYP2,CWROW2,CWCOL2,CWSZE2 

***  INTEREST  OPERATOR  VARIABLES  AREA  *** 


n  n  o  r>  n  n  non  o  oon 


COMMON  /IOP/  IOPNBR, IPFLAC 
COMMON  /MEAN/  COLSUM.SQRSUM.MEAN 
COMMON  /DSTOR/  DCOL.EPSLON, D(2 ,M) 

COMMON  /DRVAR/  XSUM.YSUM.ASUM, BSUM 
COMMON  /EDVAR/  EFLAC ,RT0MIN 

***  WINDOW  VARIABLES  AREA  *** 

COMMON  /COUNT/  WMDKNT, BUFKNT, RECNUM 

COMMON  /MOVE/  ROWKNT.COLKNT.ROWDIF.COLDIF 

COMMON  /IMAGE/  IMGROW.IMGCOL.IMGSZE, IMGINV 

COMMON  /WINDOW/  WNDROW , WNDCOL ,  WNDRWH ,  WNDCLH , WNDSZE ,  WNDINV 

COMMON  /CORWND/  CWDROW ,  CWDCOL,  CWDRWH ,  CWDCLH ,  CWDSZE ,  CWDINV 

COMMON  /DSPWND/  DWDROW , DWDCOL , DWDRWH , DWDCLH , DWDS ZE , DWDINV 

COMMON  /NBHOOD/  NGHROW ,NGHCOL, NGHRWH , NGHCLH , NGHSZE , NCHINV 

LOGICAL* 1  IBUF , IOBUFR, FNAME , FNAME 1 , FNAME2 

***  INTEGER  VARIABLES  *** 

INTEGER  END, ERROR, OPRNBR.CWROWl .CWCOLI .CWSZEl 
INTEGER  CWR0W2  .CWC0L2  .CWSZE2 ,  DCOL,  EFLAG , WNDKNT 
INTEGER  BUFKNT, RECNUM ,ROWKNT,COLKNT,ROWDIF .COLDIF 
INTECE  R  WNDROW , WNDCOL , WNDRWH , WNDCLH, WNDSZE 
INTEGER  CWDROW , CWDCOL , CWDRWH , CWDCLII , CWDSZE 
INTEGER  DWDROW, DWDCOL, DWDRWH, DWDCLH, DWDSZE 

***  REAL  VARIABLES  *** 


REAL  IMGSZE, IMGINV .NGHINV .MEAN 

***  INITIALIZATION  *** 

TYPE  *,'  ' 

TYPE  *,'  ' 

TYPE  *, 'DO  YOU  WANT  THE  PROGRAM  OUTPUT  TO  BE  ROUTED  TO  THE' 
TYPE  * , 'LINE  PRINTER  OR  SYSTEM  TEMPORARY  FILE?' 

TYPE  *,'  ' 

TYPE  *, 'IF  YOU  WANT  THE  PROGRAM  OUTPUT  TO  GO  TO  THE  LINE' 
TYPE  *, 'PRINTER,  TYPE  YES.  OTHERWISE,  TYPE  NO.  TYPING  NO' 
TYPE  *, 'CAUSES  THE  PROGRAM  OUTPUT  TO  BE  SENT  TO  THE  SYSTEM' 
TYPE  *, 'FILE  NAME:' 

TYPE  *,'  ' 

TYPE  *,'  SY:DIDAOUT.TMP' 

TYPE  ' 

TYPE  11 

ACCEPT  12, ANSWER 
CALL  ANSCHK( ANSWER) 

IF(ANSWER.Ef).  'YES'  )G0  TO  2 


193 


CALL  ASSIGN(6, 'SY:DIDAOUT.TMP' ) 

GO  TO  3 

CALL  ASSICN(6,'LP: ' ) 

ERROR  -  0 
END  -  0 

WRITE  (6, *)  '***  BEGIN  DISPARITY  ANALYSIS  PROCRAM  EXECUTION  ***' 
WRITE  (6,*)  '  ' 

WRITE  (6,*)  '  ' 

TYPE  * 

TYPE  ' 

TYPE  *, 'ENTER  THE  NUMBER  CORRESPONDING  TO  THE  OPERATION' 

TYPE  *, 'YOU  WISH  TO  PERFORM:' 

TYPE  ' 

TYPE  *,'  1.  PERFORM  IMAGE  OPERATIONS' 

TYPE  *,'  2.  FIND  INTERESTING  POINTS' 

TYPE  *,'  3.  MATCH  INTERESTING  POINTS' 

TYPE  4.  DISPLAY  IMAGES  ON  A  CRT' 

TYPE  5.  TERMINATE  PROGRAM  EXECUTION' 

TYPE  *,'  ' 

TYPE  5 

FORMAT(5X, 'OPERATION  NUMBER  -  ',$) 

ACCEPT  * .OPRNBR 

IF(OPRNBR.LT. 1 .OR.OPRNBR.GT. 5)GO  TO  50 
GO  T0( 10,20,30,40,200)0PRNBR 
CALL  IMG0PR( ERROR, END) 

IF( ERROR. EQ. 1)00  TO  100 
IF(END.EO . 1 )G0  TO  200 
TYPE  *,'  ' 

TYPE  *,  'DO  YOU  WISH  TO  PERFORM  OTHER  IMAGE  OPERATIONS?' 

TYPE  *, 'IF  YOU  DO,  TYPE  YES.  OTHERWISE,  TYPE  NO.' 

TYPE  ' 

TYPE  II 

F0RMAT(5X, 'ANSWER  -  ',$) 

ACCEPT  12 .ANSWER 
F0RMATCA3) 

CALL  ANSCHK( ANSWER) 

IF(ANSWER.EQ. 'YES' )G0  TO  10 

WRITE  (6,*)  '***  IMAGE  OPERATIONS  COMPLETED  ***' 

GO  TO  60 

CALL  INTPTS(STORE, ERROR, END) 

IFCERROR.EQ.DGO  TO  100 
IF(END.E0.1)G0  TO  200 
TYPE  *,'  ' 

TYPE  *,  'DO  YOU  WISH  TO  FIND  INTERESTING  POINTS  ON  ANOTHER  IMAGE?' 
TYPE  *, 'IF  YOU  DO,  TYPE  YES.  OTHERWISE,  TYPE  NO.' 

TYPE  *,'  ' 

TYPE  11 

ACCEPT  12, ANSWER 
CALL  ANSCHK (ANSWER) 
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IF(ANSWER.EO. 'YES' )GO  TO  20 

WRITE  (6,*)  '***  INTERESTING  POINT  PROCESSING  COMPLETE  ***' 
GO  TO  60 

CALL  IPMTCH( STORE, ERROR, END) 

IF( ERROR. EQ. I )G0  TO  100 
IF(END.EQ. 1 )G0  TO  200 
TYPE  *,'  ' 

TYPE  *,  'DO  YOU  WISH  PERFORM  MATCHING  ON  OTHER  IMAGES’' 

TYPE  *,'IF  YOU  DO, TYPE  YES.  OTHERWISE,  TYPE  NO.' 

TYPE  *,'  ' 

TYPE  11 

ACCEPT  12, ANSWER 
CALL  ANSCHK( ANSWER) 

IF(ANSWER.EQ. 'YES' )G0  TO  30 

WRITE  (6,*)  '***  INTERESTING  POINT  MATCHING  COMPLETE  ***' 

GO  TO  60 

CALL  IMGDSP(ERROR.END) 

IF (ERROR. EQ . 1 )G0  TO  100 
IF(END.EO. 1 )GO  TO  200 
TYPE  *,'  ' 

TYPE  *, 'DO  YOU  WISH  TO  DISPLAY  OTHER  IMAGES?' 

TYPE  *, ' IF  YOU  DO,  TYPE  YES.  OTHERWISE,  TYPE  NO.' 

TYPE  *,'  ' 

TYPE  11 

ACCEPT  12 .ANSWER 
CALL  ANSCHK( ANSWER) 

IF(ANSWER.EQ. 'YES' )G0  TO  40 

WRITE  (6,*)  '***  IMAGE  DISPLAY  OPERATIONS  COMPLETED  ***' 

GO  TO  60 
TYPE  *,'  ' 

TYPE  *,'***  INVALID  OPERATION  NUMBER' .OPRNBR, '  ATTEMPTED  ***' 
TYPE  *,'  ' 

TYPE  *, 'DO  YOU  WISH  TO  TERMINATE  PROGRAM  EXECUTION?' 

TYPE  *, 'IF  YOU  DO,  TYPE  YES.  OTHERWISE,  TYPE  NO.' 

TYPE  *,'  ' 

TYPE  11 

ACCEPT  12, ANSWER 
CALL  ANSCHK( ANSWER) 

IF(ANSWER.EQ.'YES')GO  TO  200 
GO  TO  1 

WRITE  (6,*)  '  ' 

WRITE  (6,*)  '***  EXIT  DIDA  -  ERROR  TERMINATION  ***' 

STOP  '***  EXIT  DIDA  -  ERROR  TERMINATION  ***' 

WRITE  (6,*)  '  ' 

WRITE  (6,*)  '  ' 

WRITE  (6,*)  '***  END  DISPARITY  ANALYSIS  PROGRAM  EXECUTION  ***' 
STOP  '***  NORMAL  TERMINATION  ***' 

END 


File:  'COMMON. FTN'  -  this  file  specifies  the  dimensions  of  all  arrays 
in  Program  DIOA.  It  includes  the  single  statement: 

PARAMETER  L»4,  M-512,  N-32 
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Appendix  £:  Inage  Operations  Section 

This  appendix  contains  the  FORTRAN  source  listing  for  the  Image 
Operations  Section  of  program  DIDA. 


SUBROUTINE  IMGOPR(IMCERR, IMGEND) 

C 

C  THIS  SUBROUTINE  IS  USED  TO  PERFORM  IMAGE  OPERATIONS.  THE 

C  IMAGE  SIZE  IS  DEFINED  FIRST.  THEN  THE  DESIRED  IMAGE  OPER- 

C  AT ION  IS  SELECTED,  AND  THAT  OPERATION  BEGINS. 

C 

D  WRITE  (6,*)  '***  ENTER  IMGOPR  ***' 

C 

C  ***  DEFINE  THE  IMAGE  SIZE  *** 

C 

CALL  IMCSZE 

***  SELECT  THE  DESIRED  IMAGE  OPERATION  *** 

CALL  IM0SEL(IMGERR, IMGEND) 

C 

RETURN 


n  n  o  non  o  n  n 


SUBROUTINE  IMGSZE 


C 

C  THIS  SUBROUTINE  ALLOWS  THE  USER  TO  DETERMINE  THE  NUMBER  OF 

C  ROWS  AND  COLUMNS  OF  THE  IMAGE  TO  BE  PROCESSED.  FROM  THIS, 

C  THE  IMAGE  SIZE  AND  ITS  INVERSE  MAY  BE  OBTAINED.  THE  USER 

C  IS  ASKED  TO  CHECK  THE  INPUT  INFORMATION  AND  MAKE  CORRECTIONS 

C  IF  NECESSARY. 

C 

COMMON  /IMAGE/  IMGROW , IMGCO L , IMS ZE , IMG INV 
REAL  IMSZE, IMGINV 
TYPE  *,'  ' 

TYPE  *, 'PLEASE  TYPE  THE  NUMBER  OF  ROWS  AND  COLUMNS' 

TYPE  *,  'OF  THE  IMAGE : ' 

TYPE  ' 

***  ENTER  THE  NUMBER  OF  ROWS  AND  COLUMNS  OF  THE  IMAGE  *** 

CALL  IRCFND 

***  COMPUTE  THE  IMAGE  SIZE  (NUMBER  OF  ROMS  X  NUMBER  OF  COLUMNS)*** 

IMSZE  -  FLOAT( IMGROW ) *FLOAT( IMGCOL ) 

***  COMPUTE  THE  INVERSE  OF  THE  IMAGE  SIZE  *** 

IMGINV  -  1.0 /IMSZE 
C 

WRITE  (6,*)  '  ' 

WRITE  (6,*)  '***  IMAGE  INFORMATION  ***' 

WRITE  (6,*)  '  ' 

WRITE  (6,*)  'NUMBER  OF  LMAGE  ROWS  -  '.IMCROW 
WRITE  (6,*)  'NUMBER  OF  IMAGE  COLUMNS  ■  '.IMCCOL 
WRITE  (6,*)  'IMAGE  SIZE  (ROWSXCOLUMNS)  -  '.IMSZE 
WRITE  (6,*)  'INVERSE  OF  IMAGE  SIZE  -  '.IMGINV 
WRITE  (6,*)  '  ' 

RETURN 

END 
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SUBROUTINE  IRCFND 


THIS  SUBROUTINE  ALLOWS  THE  USER  TO  ENTER  THE  NUMBER  OF  ROWS  AND 
COLUMNS  INTERACTIVELY  FOR  THE  IMAGE  TO  BE  INPUT  OR  OUTPUT.  THE 
USER  MAY  CORRECT  THIS  INFORMATION  IF  AN  ENTRY  ERROR  OCCURS. 

***  ENTER  THE  NUMBER  OF  ROWS  AND  COLUMNS  *** 

CALL  IMROW 
CALL  IMCOL 

***  OPTIONAL  ENTRY  INFORMATION  CHECK  *** 

TYPE  ' 

TYPE  *,  'DO  YOU  WISH  TO  CHECK  FOR  ENTRY  ERRORS?' 

TYPE  *, 'IF  YOU  DO,  TYPE  YES.  OTHERWISE,  TYPE  NO.' 

TYPE  ' 

TYPE  1 

FORMAT(5X, 'ANSWER  -  ',S) 

ACCEPT  2, ANSWER 
FORMAT(A3) 

***  CHECK  ANSWER  ENTRY  *** 


CALL  ANSCHK( ANSWER) 

IF(ANSWER.EQ.*NO')GO  TO  3 

***  CHECK  ENTRY  INFORMATION  *** 

CALL  IRCCHK 
C 

3  RETURN 

END 


199 


O  O  O  O  O  -4  ouu  u  o  o  o  u  u  o 


SUBROUTINE  IRCCHK 


THIS  SUBROUTINE  ALLOWS  THE  USER  TO  CHECK  THE  INFORMATION 
INPUT  FOR  THE  NUMBER  OF  ROUS  AND  COLUMNS  OF  THE  IMAGE,  AND 
TO  CORRECT  THEM  IF  DESIRED. 

COMMON  /IMAGE/  IMGROW.IMGCOL 
TYPE  ' 

TYPE  *, 'HERE  IS  WHAT  YOU  HAVE  INPUT:' 

TYPE  ' 

***  DISPLAY  THE  NUMBER  OF  IMAGE  ROWS  AND  COLUMNS  *** 

TYPE  *, 'NUMBER  OF  IMAGE  ROWS  -  '.IMGROW 
TYPE  *, 'NUMBER  OF  IMAGE  COLUMNS  -  '.IMCCOL 

***  VERIFY  THE  CORRECT  RESPONSE  *** 

CALL  VERIFY( ANSWER) 

IF(ANSWER.EQ. 'YES' )GO  TO  2 

***  CHANGE  INCORRECT  INFORMATION  *** 

CALL  IFCCOR 
C 

GO  TO  1 
2  RETURN 

END 
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SUBROUTINE  IRCCOR 


THIS  SUBROUTINE  ALLOWS  THE  USER  TO  CORRECT  THE  INFORMATION 
INPUT  FOR  THE  NUMBER  OF  IMAGE  ROWS  AND  COLUMNS. 

REAL  ITEM 


***  MAKE  ERROR  CORRECTIONS  *** 


TYPE  ' 

TYPE  *, 'DO  YOU  WANT  TO  CHANGE  THE  NUMBER  OF  ROWS,  COLUMNS, ' 

TYPE  *,  'OR  BOTH?' 

TYPE  *,  'IF  YOU  WANT  TO  CHANGE  THE  NUMBER  OF  ROWS,  TYPE  ROWS.' 

TYPE  *, 'IF  YOU  WANT  TO  CHANCE  THE  NUMBER  OF  COLUMNS,  TYPE  COLS.' 

TYPE  *, 'IF  YOU  WANT  TO  CHANGE  BOTH,  TYPE  BOTH.' 

TYPE  *,'  ' 

TYPE  2 

FORMAT(5X,'ITEM  YO»-  WISH  TO  CHANGE  -  ',$) 

ACCEPT  3, ITEM 
FORMAT(A4) 

IF< ITEM. EQ. 'BOTH' )GO  TO  10 
IF ( ITEM. EQ. 'ROWS' )C0  TO  20 
IF(ITEM.EQ. 'COLS' )G0  TO  30 
TYPE  ' 

TYPE  *,'***  ITEM  ENTRY  ERROR  -  PLEASE  RETYPE  ***' 

TYPE  ' 

GO  TO  1 


***  CHANGE  BOTH  NUMBER  OF  ROWS  AND  COLUMNS  *** 

CALL  IMROW 
CALL  IMCOL 
RETURN 

***  CHANGE  NUMBER  OF  ROWS  *** 

CALL  IMROW 
RETURN 

***  CHANGE  NUMBER  OF  COLUMNS  *** 

CALL  IMCOL 

RETURN 

END 
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SUBROUTINE  IMROW 


THIS  SUBROUTINE  ALLOWS  THE  USER  TO  INPUT  THE  NUMBER  OF  ROWS  OF 
THE  IMAGE  TO  BE  INPUT  OR  OUTPUT. 

INCLUDE  'COMMON. FTN' 

COMMON  /IMAGE/  IMCROW 

***  ENTER  THE  NUMBER  OF  IMAGE  ROWS  *** 

1  TYPE  2 

2  PORMAT(5X, 'NUMBER  OF  IMAGE  ROWS  -  ',$) 

ACCEPT  *, IMCROW 

C 

IF (IMCROW.LT. 5 )G0  TO  10 
IF(IMGROW.GT.M)GO  TO  20 
RETURN 

10  TYPE  ' 

TYPE  *,'***  IMAGE  ROW  SIZE  EXCESSIVELY  SMALL  ***' 

TYPE  ' 

TYPE  *,'  IMAGE  ROW  SIZE  INPUT  -  '.IMGROW 
TYPE  *,'  ' 

TYPE  *, 'DO  YOU  WISH  TO  CHANGE  THE  IMAGE  ROW  SIZE  INPUT?' 

TYPE  *, 'IF  YOU  DO,  TYPE  YES.  OTHERWISE,  TYPE  NO.' 

TYPE  ' 

TYPE  11 

11  FORMAT  (5X, 'ANSWER-  ',$) 

ACCEPT  12, ANSWER 

12  P0RMAT(A3) 

CALL  ANSCHK( ANSWER) 

IF(ANSWFR.EQ. 'YES' )G0  TO  1 
RETURN 

20  TYPE  *,'  ' 

TYPE  *, 'IMAGE  ROW  SIZE  EXCEEDS  MAXIMUM  ALLOWABLE  COLUMN  SIZEr'.M 
TYPE  *,'  ' 

TYPE  *, 'ARE  YOU  SURE  YOU  WANT  TO  USE  THIS  IMAGE  ROW  SIZE?' 

TYPE  *, 'IF  YOU  ARE,  TYPE  YES.  OTHERWISE,  TYPE  NO.' 

TYPE  *, '  ' 

TYPE  II 

ACCEPT  12, ANSWER 
CALL  ANSCHK( ANSWER) 

IF(ANSWER.EQ.'NO')GO  TO  1 

RETURN 

END 
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SUBROUTINE  IMCOL 


THIS  SUBROUTINE  ALLOWS  THE  USER  TO  INPUT  THE  NUMBER  OF  COLUMNS 
OF  THE  IMAGE  TO  BE  INPUT  OR  OUTPUT. 

INCLUDE  ' COMMON. FTN' 

COMMON  /IMAGE/  IX, IMGCOL 

***  ENTER  THE  NUMBER  OF  IMAGE  COLUMNS  *** 

TYPE  1 

FORMAT(5X, 'NUMBER  OF  IMAGE  COLUMNS  -  ',$) 

ACCEPT  *, IMGCOL 
IF(IMGCOL.GT.M)GO  TO  2 
IF( IMGCOL.LT. 5 )GO  TO  3 

RETURN 
TYPE  ' 

TYPE  *,'***  MAXIMUM  IMAGE  COLUMN  SIZE'.M,'  EXCEEDED  IN  IMCOL  ***' 
GO  TO  4 
TYPE  ' 

TYPE  *,'***  IMAGE  COLUMN  SIZE  EXCESSIVELY  SMALL  ***' 

***  CORRECT  COLUMN  SIZE  *** 

CALL  IRCCHK 

IF( IMGCOL. GT.M)GO  TO  2 

RETURN 

END 
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SUBROUTINE  VERIFY (ANSWER) 

THIS  SUBROUTINE  ALLOWS  THE  USER  TO  VERIFY  THE  RESPONSE 
GIVEN  TO  THE  INFORMATION  INPUT. 

TYPE  *,'  ' 

TYPE  *,'IS  THIS  THE  CORRECT  INFORMATION  INPUT?' 

TYPE  *, 'IF  SO,  TYPE  YES.  OTHERWISE,  NO.' 

TYPE  *,'  ' 

TYPE  1 

FORMAT(5X, 'ANSWER  -  ',$) 

ACCEPT  2, ANSWER 
FORMAT(A3) 

***  CHECK  ANSWER  RESPONSE  *** 

CALL  AN SCHK( ANSWER) 

RETURN 

END 


SUBROUTINE  ANSCHK( ANSWER) 

THIS  SUBROUTINE  ALLOWS  THE  USER  TO  CHECK  A  YES/NO  ANSWER 
RESPONSE  FOR  AN  INCORRECT  ENTRY. 

IF(ANSWER.EQ. 'YES' .OR. ANSWER. EQ. 'NO' )RETURN 

***  CORRECT  ANSWER  RESPONSE  *** 

CALL  ANSCOR(ANSWER) 

RETURN 

END 


SUBROUTINE  ANSCOR( ANSWER) 

THIS  SUBROUTINE  ALLOWS  THE  USER  TO  CORRECT  AN  INCORRECT 
YES/NO  ANSWER  ENTRY. 

1  TYPE  ' 

TYPE  *,'***  ANSWER  ENTRY  ERROR  -  PLEASE  RETYPE  ***' 

TYPE  *,'  ' 

TYPE  2 

2  FORMAT(5X, 'ANSWER  -  \S) 

ACCEPT  3, ANSWER 

3  FORMAT(A3) 
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IP(ANSWIR.EQ.  'YES' . OR. ANSWER. EO. 'NO'  )REWRN 
CO  TO  1 


n  n  a  n 


SUBROUTINE  IMOSEL(IMOERR, IMOEND) 


THIS  SUBROUTINE  ALLOWS  THE  USER  TO  SELECT  THE  IMAGE  OPERATION 
DESIRED.  THE  IMAGE  OPERATION  IS  THEN  PERFORMED. 

1  TYPE  ' 

TYPE  *, 'ENTER  THE  NUMBER  CORRESPONDING  TO  THE  IMAGE  OPERATION' 
TYPE  *, 'YOU  WISH  TO  PERFORM:' 

TYPE  *,'  ' 

TYPE  I.  PRINT  IMAGE  INTENSITIES' 

TYPE  *,'  2.  DELETE  AN  IMAGE  FILE' 

TYPE  *,'  3.  CREATE  A  NEW  IMAGE  FILE' 

TYPE  *,'  4.  NONE  YET' 

TYPE  *,'  5.  NONE  YET' 

TYPE  6.  TERMINATE  DIAGE  OPERATIONS' 

TYPE  *,'  7.  TERMINATE  PROGRAM  EXECUTION' 

TYPE  ' 

TYPE  5 

5  FORMAT(5X, 'OPERATION  NUMBER  -  ',S) 

ACCEPT  * , IMONBR 

IF(IMONBR.LT. 1 .OR. IMONBR.GT. 7)GO  TO  100 
GO  T0(1 0,20, 30, 40, 50, 60, 70) IMONBR 
10  CALL  IMOPR 1 ( IMOERR) 

RETURN 

20  CALL  IM0PR2 ( IMOERR ) 

RETURN 

30  CALL  IMOPR 3 (IMOERR, IMOEND) 

RETURN 

40  CALL  IM0PR4( IMOERR) 

GO  TO  1 

50  CALL  IM0PR5( IMOERR) 

GO  TO  1 
60  RETURN 

70  IMOEND  -  1 

RETURN 

100  TYPE  ' 

TYPE  *,'***  INVALID  OPERATION  NUMBER '.IMONBR, '  ATTEMPTED  ***' 

GO  TO  1 

END 
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SUBROUTINE  IMOPRl (IMOERR) 


C 

C  THIS  SUBROUTINE  ALLOWS  THE  USER  TO  PRINT  AN  IMAGE  FILE  ON  THE 

C  LINE  PRINTER.  THE  LOGICAL  UNIT  NUMBER  AND  FILE  NAME  ARE  ENTERED 

C  INTERACTIVELY,  AND  THE  USER  MAY  CORRECT  THEM  IF  AN  ENTRY  ERROR 

C  OCCURS. 

C 

INCLUDE  'COMMON. FTN' 

COMMON  /BUF/  IOBUFR(L.M) 

COMMON  /INBUF/  INTBUF(M) 

COMMON  /IMAGE/  IMGROW , IMGCOL 
LOGICAL* 1  IOBUFR 
INTEGER  RECNUM 

WRITE  (6,*)  '***  ENTER  IMOPRl  ***' 

***  ENTER  THE  LOGICAL  UNIT  NUMBER  AND  FILE  NAME  *** 

TYPE  *,'  ' 

TYPE  *, 'PLEASE  ENTER  THE  LOGICAL  UNIT  NUMBER  AND  FILE  NAME  FOR' 
TYPE  *, 'THE  IMAGE  FILE  YOU  WISH  TO  PRINT:' 

CALL  FLUFND 

***  OPEN  THE  FILE  DEFINED  BY  THE  LOGICAL  UNIT  NUMBER  AND  FILENAME 
PREVIOUSLY  ENTERED  *** 

CALL  OPNOLD( IMOERR) 

IF ( IMOERR. EQ . 1 )RETURN 

DO  30  RECNUM- 1 , IMGROW 

***  READ  THE  IMAGE  INTENSITY  DATA  FROM  THE  IMAGE  FILE  *** 

I  -  1 

CALL  INPUT(RECNUM, I, IMOERR) 

IF ( IMOERR. EQ. 1 )RETURN 

***  PERFOPM  BYTE  TO  WORD  NUMBER  CONVERSION  *** 

DO  10  J-l, IMGCOL 
INTBUF(J)  -  IOBUFR( 1 , J) 

IF(INTBUF(J).LT.O)INTBUF(J)  -  INTBUF(J)  +  256 
0  CONTINUE 

***  WRITE  THE  IMAGE  INTENSITY  DATA  TO  THE  LINE  PRINTER  *** 

WRITE  (6,*)  'RECORD  NUMBER' .RECNUM, ' 

WRITE  (6,15) 

15  F0RMAT(1X,24( '-' )) 

WRITE  (6, 20)(INTBUF(J), J-l .IMGCOL) 
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FORMAT(26(2X, 13) , / ) 
WRITE  (6,*)  '  ' 


C 

30  CONTINUE 

C 

C  ***  CLOSE  THE  IMAGE  FILE  *** 

C 

CALL  CLOSKP(IMOERR) 

C 

RETURN 

END 
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SUBROUTINE  LMOPR2(IMOERR) 


C 

C  THIS  SUBROUTINE  ALLOWS  THE  USER  TO  DELETE  A  SPECIFIED  FILE. 

C  THE  LOGICAL  UNIT  NUMBER  AND  FILE  NAME  ARE  ENTERED  INTER- 

C  ACTIVELY,  AND  THE  USER  MAY  CORRECT  THEM  IF  AN  ENTRY  ERROR 

C  OCCURS. 

C 

D  WRITE  (6,*)  '***  ENTER  IMOPR2  ***' 

C 

C  ***  ENTER  THE  LOGICAL  UNIT  NUMBER  AND  FILE  NAME  *** 

C 

TYPE  ' 

TYPE  *, 'PLEASE  ENTER  THE  LOGICAL  UNIT  NUMBER  AND  FILE  NAME  FOR' 
TYPE  * , 'THE  IMAGE  FILS  YOU  WISH  TO  DELETE:' 

CALL  FLUFND 

***  OPEN  THE  FILE  TO  BE  DELETED  WHICH  IS  DEFINED  BY  THE  LOGICAL 
UNIT  NUMBER  AND  FILENAME  PREVIOUSLY  ENTERED  *** 

CALL  OPNOLD(IMOERR) 

***  CLOSE  THE  FILE  WITH  THE  DELETE  DISPOSITION  OPTION  *** 

CALL  CLOSDL(IMOERR) 

IF( IMOERR. EQ . 1 )RETURN 
C 

TYPE  ' 

TYPE  *,'***  IMAGE  FILE  DELETED  ***' 

WRITE  (6,*)  '  ' 

WRITE  (6,*)  '***  IMAGE  FILE  DELETED  ***' 

WRITE  (6,*)  '  ' 

RETURN 

END 
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SUBROUTINE  IM0PR3(IM0ERR, IMQEHD) 


C 

C  THIS  SUBROUTINE  CREATES  A  NEW  IMAGE  FILE  FROM  AN  ALGORITHM 

C  WHICH  THE  USER  SELECTS.  THE  LOGICAL  UNIT  NUMBER  AND  FILE 

C  NAME  ARE  ENTERED  INTERACTIVELY,  AND  THE  USER  MAY  CORRECT  THEM 

C  IF  AN  ENTRY  ERROR  OCCURS. 

C 

D  WRITE  (6,*)  '***  ENTER  IMOPR3  ***' 

C 

C  ***  ENTER  THE  LOGICAL  UNIT  NUMBER  AND  FILE  NAME  *** 

C 

TYPE  ' 

TYPE  *, 'PLEASE  ENTER  THE  LOGICAL  UNIT  NUMBER  AND  FILE  NAME  FOR' 
TYPE  * , 'THE  NEW  IMAGE  FILE  YOU  WISH  TO  CREATE:' 

CALL  FLUFND 

***  OPEN  THE  FILE  DEFINED  BY  THF.  LOGICAL  UNIT  NUMBER  AND  FILENAME 
PREVIOUSLY  ENTERED  *** 

CALL  OPNNEW( IMOERR) 

IF(IMOERR.EO. I ) RETURN 

***  SELECT  THE  ALGORITHM  TO  BE  USED  TO  CREATE  THE  NEW  IMAGE  *** 

CALL  IMASEL(IMOERR, IMOEND) 

IF ( IMOERR. EQ . 1 )RETURN 

***  CLOSE  THE  FILE  PREVIOUSLY  OPENED  *** 

CALL  CLOSKP( IMOERR) 

C 

RETURN 

END 


SUBROUTINE  IMOPR4(IMOERR) 

TYPE  *,'***  IMOPR4  NOT  AVAILABLE  AT  THIS  TIME  ***' 

RETURN 

END 


SUBROUTINE  IMOPR5( IMOERR) 

TYPE  *,'***  IMOPR5  NOT  AVAILABLE  AT  THIS  TIME  ***' 

RETURN 

END 
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SUBROUTINE  FLUFND 


I 


I 

I 


1 


C 

C 

c 

c 

c 

c 


c 

c 

c 


c 

c 

c 


1 

2 

c 

c 

c 

c 


I 

I 

I 

I 

I 

I 


c 

c 

c 

c 

3 


4 


THIS  SUBROUTINE  ALLOWS  THE  USER  TO  ENTER  THE  LOGICAL  UNIT 
NUMBER  AND  FILE  NAME  INTERACTIVELY  FOR  IMAGE  IVPUT/OUTPUT 
OPERATIONS.  THE  USER  MAY  CORRECT  THIS  INFORMATION  IF 
AN  ENTRY  ERROR  OCCURS. 

COMMON  /FILE/  LUN.NCHAR, FNAME( 34) 

LOGICAL*!  ENAME 

***  ENTER  THE  LOCICAL  UNIT  NUMBER  AND  FILE  NAME  *** 

CALL  LUNBR 
CALL  FILENM 

***  OPTIONAL  ENTRY  INFORMATION  CHECK  *** 

TYPE  *,'  ' 

TYPE  *,  'DO  YOU  V/ISH  TO  CHECK  FOP  ENTRY  ERRORS?' 

TYPE  *, ' IF  YOU  DO,  TYPE  YES.  OTHERWISE,  TYPE  NO.' 

TYPE  *,'  ' 

TYPE  1 

FORMAT(5X, 'ANSWER  -  ',$) 

ACCEPT  2, ANSWER 
FORMAT(A3) 

***  CHECK  ANSWER  ENTRY  *** 

CALL  ANSCHK (ANSWER) 

IF (ANSWER. EQ. 'NO' )GO  TO  3 
***  CHECK  ENTRY  INFORMATION  *** 

CALL  FLUCHK 
WRITE  (6,*)  '  ' 

WRITE  (6,*)  '***  IMAGE  FILE  INFORMATION  ***' 

WRITE  (6,*)  '  ' 

WRITE  (6,*)  'LOGICAL  UNIT  NUMBER  -  ' ,LUN 
WRITE  (6,4)  (FNAME(I) , 1*1 ,NCHAR) 

FORMAT( 1 X, ' FILENAME  -  ' , <NCHAR+1 >A 1 ) 

WRITE  (6,*)  '  ' 

RETURN 

END 
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SUBROUTINE  FLUCHK 


C 

C  THIS  SUBROUTINE  ALLOWS  THE  USER  TO  CHECK  THE  INFORMATION 

C  INPUT  FOR  THE  FILE  NAME  AND  LOGICAL  UNIT  NUMBER,  AND  TO 

C  CORRECT  THEM  IF  DESIRED. 

C 

COMMON  /FILE/  LUN.NCHAR, FNAME( 34) 

LOGICAL*  1  FNA.’fE 
1  TYPE  *,'  ' 

TYPE  *, 'HERE  IS  WHAT  YOU  HAVE  INPUT:' 

TYPE  *,'  ' 

***  DISPLAY  THE  FILE  NAME  AND  LOGICAL  UNIT  NUMBER  INPUT  *** 

TYPE  *, 'LOGICAL  UNIT  NUMBER  -  ',Lt!N 
TYPE  2,(FNAME(I),I-1,NCHAR) 

FORMAT( 1 X, 'FILENAME  -  ' ,<NCHAR+l>Al) 

***  VERIFY  THE  CORRECT  RESPONSE  *** 

CALL  VERIFY (ANSWER) 

IF(ANSUER.Ef).  'YES'  )GO  TO  3 

***  CHANGE  INCORRECT  INFORMATION  *** 

CALL  FLUCOP. 

C 

GO  TO  1 
3  RETURN 

END 
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SUBROUTINE  FLIJCOR 


THIS  SUBROUTINE  ALLOWS  THE  USER  TO  CORRECT  THE  INFORMATION 
INPUT  FOR  THE  FILE  NAME  AMO  LOGICAL  UNIT  NUMBER. 

REAL  ITEM 

***  MAKE  ERROR  CORRECTIONS  *** 

TYPE  ' 

TYPE  *,  'DO  YOU  WANT  TO  CHANCE  THE  LOGICAL  UNIT  NUMBER,' 

TYPE  * , ' FI LK  NAME,  OR  BOTH?' 

TYPE  *, 'IF  YOU  WANT  TO  CHANGE  THE  LOGICAL  UNIT  NUMBER,  TYPE  LUN. ' 
TYPE  *,'IF  YOU  WANT  TO  CHANGE  THE  FILE  NAME,  TYPE  FILE.' 

TYPE  *,  'IF  YOU  WANT  TO  CHANGE  ROTH,  TYPE  BOTH.' 

TYPE  ' 

TYPE  2 

FORMAT(5X, 'ITEM  YOU  WISH  TO  CHANGE  -  ',$) 

ACCEPT  3 .ITEM 
FORMAT(A4) 

IF(ITEM.EQ.'ROTH')GO  TO  10 
IF( ITEM. EQ. 'LUN' )GO  TO  20 
IF(ITEM.EQ. 'FILE' )GO  TO  30 
TYPE  ' 

TYPE  *,'***  ITEM  ENTRY  ERROR  -  PLEASE  RETYPE  ***' 

TYPE  ' 

CO  TO  1 

***  CHANGE  BOTH  FILE  NAME  AND  LOGICAL  UNIT  NUMBER  *** 

0  CALL  FILENM 

CALL  LUNBR 
RETURN 

***  CHANGE  LOGICAL  UNIT  NUMBER  *** 

0  CALL  LUNBR 

RETURN 

***  CHANGE  FILE  NAME  *** 

30  CALL  FILENM 

RETURN 
END 
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SUBROUTINE  FILENM 

THIS  SUBROUTINE  ALLOWS  THE  USER  TO  INPUT  THE  FILE  NAME  OF 
THE  FILE  BEING  USED  FOR  INPUT/OUTPUT  OPERATIONS. 

COMMON  /FILE/  IX , NCHAR , FNAME ( 34 ) 

LOCICALM  FNAME 
TYPE  ' 

TYPE  *, 'WHAT  DEVICE/UIC/FILENAME  DO  YOU  WISH  TO  USE?' 

TYPE  *, 'ENTER  ACCORDING  TO  THE  FOLLOWING  FORMAT:' 

TYPE  ' 

TYPE  DEV: I  UIC  JFILENAME. TYPE: VERSION' 

TYPE  *, 'EXAMPLE:  DK1 : [ 10, 20]FILENAME. IMG; 3' 

TYPE  ' 

***  INPUT  THE  DESIRED  FILE  NAME  *** 

TYPE  1 

1  FORMAT( 5 X, 'FILENAME  -  ',$) 

ACCEPT  2, NCHAR, FNAME 

2  FORMAT(Q , 34A1 ) 

FNAME (NCHAR+I )  -  0 

C 

RETURN 

END 
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SUBROUTINE  LUNBR 


THIS  SUBROUTINE  ALLOWS  THE  USER  TO  INPUT  THE  LOGICAL  UNIT 
NUMBER  ASSOCIATED  WITH  THE  FILE  TO  BE  USED  FOR  INPUT  AND 
OUTPUT  OPERATIONS. 

COMMON  /FILE/  LIJN 
TYPE  ' 

TYPE  * , ' WHAT  LOGICAL  UNIT  NUMBER  YOU  WISH  TO  USE  (1-10)?' 

TYPE  ' 

***  INPUT  THE  DESIRED  LOGICAL  UNIT  NUMBER  *** 

TYPE  2 

FORMAT(5X,'LOCICAL  UNIT  NUMBER  -  ',$) 

ACCEPT  *, LUN 

***  CHECK  FOR  INCORRECT  NUMBER  *** 

IF(LUN.LT. I .OR.LUN.GT. 10)GO  TO  3 
IF(LUN.E0.5)G0  TO  4 
IF(LUN.EQ.6)G0  TO  5 
C 

RETURN 

3  TYPE  ' 

TYPE  *,'***  INVALID  LOGICAL  UNIT  NUMBER' , LUN, '  ATTEMPTED  ***' 
TYPE  ' 

TYPE  *, 'LOGICAL  UNIT  NUMBER  MUST  BE  BETWEEN  I  AND  10.' 

GO  TO  1 

4  TYPE  ' 

TYPE  *, 'LOGICAL  UNIT  5  IS  RESERVED  FOR  THE  USERS  TERMINAL.' 
TYPE  *, 'PLEASE  USE  ANOTHER  NUMBER!' 

GO  TO  1 

5  TYPE  ' 

TYPE  *, 'LOGICAL  UNIT  6  IS  RESERVED  FOR  THE  LINE  PRINTER.' 

TYPE  *, 'PLEASE  USE  ANOTHER  NUMBER!' 

GO  TO  1 
END 
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SUBROUTINE  IMASEL( IMAERR, IMAEND) 

C 

C  THIS  SUBROUTINE  ALLOWS  THE  USER  TO  SELECT  THE  ALGORITHM 

C  TO  BE  USED  TO  FIND  THE  INTENSITY  VALUES  OF  THE  IMAGE 

C  ELEMENTS  OF  THE  NEW  IMAGE  TO  BE  CREATED. 

C 

1  TYPE  *,'  ' 

TYPE  *, 'ENTER  THE  NUMBER  CORRESPONDING  TO  THE  ALGORITHM .YOU  WISH' 
TYPE  *, 'TO  USE  TO  FIND  THE  INTENSITIES  OF  THE  IMAGE  ELEMENTS:' 
TYPE  *,'  ' 

TYPE  *,'  1.  RANDOM  INTENSITY  DISTRIBUTION' 

TYPE  2.  USER  TERMINAL  INPUT' 

TYPE  *,'  3.  CARD  READER  INPUT' 

TYPE  *,'  4.  NONE  YET' 

TYPE  5.  NONE  YET' 

TYPE  6.  TERMINATE  PROCRAM  EXECUTION' 

TYPE  ' 

TYPE  5 

5  FORMAT(5X, 'ALGORITHM  NUMBER  -  ',S) 

ACCEPT  *, IMANBR 

IF( IMANBR.LT. 1 .OR. IMANBR.GT.6)GO  TO  100 
GO  T0( 10,20, 30,40, 50, 60)IMANBR 
10  CALL  IMALG1 ( IMAERR) 

RETURN 

20  CALL  IMALG2 (IMAERR) 

RETURN 

30  CALL  IMALG3C IMAERR) 

RETURN 

40  CALL  IMALG4( IMAERR) 

GO  TO  1 

50  CALL  IMALG5 (IMAERR) 

GO  TO  1 

60  IMAEND  -  1 

RETURN 

100  TYPE  *,'  ' 

TYPE  *,'***  INVALID  ALGORITHM  NUMBER' , IMANBR, '  ATTEMPTED  ***' 

GO  TO  I 
END 
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SUBROUTINE  LMALG1 (IMAERR) 

C 

C  THIS  SUBROUTINE  ASSIGNS  RANDOMLY  SELECTED  VALUES  TO  THE 

C  IMAGE  ELEMENTS  OF  THE  IMAGE  BEING  CREATED,  THEM  OUTPUTS  THEM. 

C 

INCLUDE  'COMMON. FTN' 

COMMON  /BUF/  IOBUFR(L.M) 

COMMON  /INBUF/  INTBUF(M) 

COMMON  /IMAGE/  IMCROW, IMCCOL 
LOGICAL* 1  IOBUFR 
INTEGER  RECNUM 
INTEGER* A  SEED 

D  WRITE  (6,*)  '***  ENTER  IMALG1  ***' 

C 

C  ***  ASSIGN  SEED  AN  INITIAL  VALUE  *** 

C 

CALL  SEEDFD(SEED) 

C 

DO  20  RECNUM- 1, IMCROW 
DO  10  J-l , IMGCOL 
C 

C  ***  ASSIGN  THE  INTENSITY  VALUES  *** 

C 

INTBUF(J)  -  RAN(SEED)*256.0 
IOBUFR(l.J)  -  INTBUF(J) 

C 

10  CONTINUE 

C 

C  ***  WRITE  TO  THE  LINE  PRINTER  *** 

C 

D  WRITE  (6,*)  'RECORD  NUMBER '.RECNUM, ' 

D  WRITE  (6.1A) 

D14  PORMAT( 1X,24( '-' ) ) 

D  WRITE  (6, 15)(INTBUF(J), J-l, IMGCOL) 

D15  FORMAT(26(2X, 13) ) 

D  WRITE  (6,*)  '  ' 

C 

C  ***  OUTPUT  EACH  RECORD  TO  THE  IMAGE  FILE  *** 

C 

I  -  1 

CALL  OUTPUT (RECNUM, I , IMAERR) 

IF ( IMAERR. EQ . 1 )RETURN 
C 

20  CONTINUE 

RETURN 
END 
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SUBROUTINE  SEEDFD(SEED) 

C 

C  THIS  SUBROUTINE  ALLOWS  THE  USER  TO  INTERACTIVELY  INPUT  A 

C  SEED  VALUE  TO  BE  USED  BY  THE  RANDOM  NUMBER  GENERATOR  FOR 

C  CALCULATING  RANDOM  INTENSITY  VALUES. 

C 

INTEGER* 4  SEED 

***  ASSIGN  SEED  AN  INITIAL  VALUE  *** 

ANSWER  -  'YES' 

TYPE  *,'  ' 

TYPE  *, 'WHAT  IS  THE  SEED  VALUE  YOU  WISH  TO  USE  FOR  THE' 

TYPE  * , ' RANDOM  NUMBER  GENERATOR?' 

TYPE  * , ' EACH  DIFFERENT  SEED  VALUE  GENERATES  A  DIFFERENT' 

TYPE  *, 'RANDOM  SEQUENCE  OF  NUMBERS  FROM  0  TO  255.' 

TYPE  *,'  ' 

IF(ANSWER.£Q.'NO')TYPE  *, 'INPUT  A  NEW  SEED  VALUE' 

TYPE  *,'  ' 

TYPE  2 

FORMAT( 5X, ' SEED  -  '.$) 

ACCEPT  *,SEED 
TYPE  *,'  ' 

TYPE  *, 'HERE  IS  WHAT  YOU  HAVE  INPUT:' 

TYPE  ' 

***  DISPLAY  THE  SEED  VALUE  *** 

TYPE  *, 'SEED  -  '.SEED 
TYPE  *,'  ' 

***  VERIFY  THE  CORRECT  RESPONSE  *** 

CALL  VERIFY (ANSWER) 

C 

IF(ANSWER.EQ.'NO')GO  TO  I 
WRITE  (6,*)  '  ' 

WRITE  (6,*)  '***  SEED  VALUE  FOR  RANDOM  NUMBER  GENERATOR  ***' 
WRITE  (6,*)  '  ' 

WRITE  (6,*)  'SEED  -  '.SEED 
WRITE  (6,*)  '  ' 

RETURN 

END 
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SUBROUTINE  IMALG2 (IMAERR) 


C 

C  THIS  SUBROUTINE  ASSIGNS  INTENSITY  VALUES  TO  THE  IMAGE 

C  ELEMENTS  OF  THE  IMAGE  BEING  CREATED  USING  THE  USER'S 

C  TERMINAL.  THE  INTENSITY  VALUES  ARE  ENTERED  ONE  RECORD 

C  AT  A  TIME.  EACH  VALUE  IS  SEPARATED  BY  ONE  OR  MORE  SPACES 

C  OR  TABS,  OR  A  COMMA  (WITH  OR  WITHOUT  SURPOUNDING  SPACES). 

C  EACH  RECORD  IS  TERMINATED  WITH  A  SLASH  (/).  INTENSITY 

C  DATA  MAY  BE  LISTED  AS  A  SINGLE  VALUE,  A  REPETITION  OF 

C  THE  FORM  (NUM-OF- REPS* VALUE) ,  OR  A  REPETITION  OF  ZEROS 

C  OF  THE  FORM  (NUM-OF-REPS*  ),  WHERE  NUM-OF -REPS  REPRESENTS 

C  THE  NUMBER  CORRESPONDING  TO  THE  NUMBER  OF  TIMES  THE  VALUE 

C  IS  TO  BE  SUCCESSIVELY  REPEATED. 

C 

INCLUDE  'COMMON. FTN' 

COMMON  /BUF/  IOBUFR(L,M) 

COMMON  /INBUF/  INTBUF(M) 

COMMON  /IMAGE/  IMGROW, IMGCOL 
LOGICAL* 1  IOBUFR 
INTEGER  RF.CNUM 

D  WRITE  (6,*)  '***  ENTER  IMALG2  ***' 

TYPE  *, '  ' 

TYPE  *, 'ENTER  INTENSITY  VALUES  ONE  RECORD  AT  A  TIME.' 

TYPE  *,' SEPARATE  EACH  VALUE  WITH  ONE  OR  MORE  SPACES  OR  TABS,' 

TYPE  * , 'OR  A  COMMA  (WITH  OR  WITHOUT  SURROUNDING  SPACES).' 

TYPE  *, 'TERMINATE  EACH  RECORD  WITH  A  STASH  (/).' 

TYPE  *, 'VALUES  MAY  BE  REPEATED  USING  THE  FORM  (NUM-OF-REPS*VALUE) ' 
TYPE  *, 'OR  (NUM-OF-REPS*  )  FOR  ZEROS.' 

TYPE  *,'  ' 

TYPE  *,'  EXAMPLE:' 

TYPE  *,'  ' 

TYPE  *, 'ENTER  RECORD  NUMBER  5  [END  WITH  /  AND  <CR>]' 

TYPE  *,'  ' 

TYPE  *,'  3,  7  12*37.245,  16*,  2,0,  100  /' 

TYPE  *,'  ' 

TYPE  *, 'IN  THE  ABOVE  EXAMPLE,  THE  FIRST  TOO  RECORD  VALUES  WILT/ 
TYPE  *, 'BE  3  AND  7,  FOLLOWED  BY  TWELVE  VALUES  OF  37.245,  SIX-' 

TYPE  * , ' TEEN  VALUES  OF  ZERO,  AND  THE  NUMBERS  2,  ZERO,  AND  100.' 
TYPE  *,'  ' 

DO  20  RECNUM»1, IMGROW 
***  ENTER  EACH  RECORD  INTERACTIVELY  *** 

TYPE  *, 'ENTER  RECORD  NUMBER' .RECNUM,'  [END  WITH  /  AND  <CR>]' 

TYPE  *,'  ' 

ACCEPT  *,(IOBUFR(l,J),J-l, IMGCOL) 

***  PERFORM  BYTE  TO  WORD  NUMBER  CONVERSION  *** 
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DO  5  J-l.IMCCOL 
INTBUF(J)  -  IOBUFR(l.J) 

IF ( I NTBUF (J).LT.O)I NTBUF ( J )  -  INTBUF(J)  +  256 
CONTINUE 

***  WRITE  TO  LINE  PRINTER  *** 

WRITE  (6,*)  'RECORD  NUMBER' .RECNUM, '  :' 

WRITE  (6,9) 

FORMAT( IX,24('-')) 

WRITE  ( 6 , 1 0 ) ( I NTBUF ( J ) , J- 1 , IMCCOL) 
FORMAT(26(2X, 13)) 

WRITE  (6,*)  '  ' 

***  OUTPUT  EACH  RECORD  TO  THE  LMAGE  FILE  *** 
1-1 

CALL  OUTPUT (RECNUM, I, IMAERR) 

IF( IMAERR. EO . 1 )RETURN 

CONTINUE 

RETURN 

END 
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THIS  SUBROUTINE  ASSIGNS  INTENSITY  VALUES  TO  THE  IMAGE 
ELEMENTS  OF  THE  IMAGE  BEING  CREATED  USING  THE  CARD  READER. 

EACH  CARD  CONTAINS  A  SERIES  OF  INTENSITY  VALUES  SEPARATED 
BY  ONE  OR  MORE  SPACES  OR  TA3S,  OR  A  COMMA  (WITH  OR  WITHOUT 
SURROUNDING  SPACES).  EACH  RECORD  (NOT  CARD)  IS  TERMINATED 
WITH  A  SLASH  (/).  INTENSITY  VALUES  MAY  BE  LISTED  AS  A  SINGLE 
NUMBER,  A  REPETITION  OF  THE  FORM  (NUM-OF-REPS*VALUE) ,  OR  A 
REPETITION  OF  ZEROS  OF  THE  FORM  (NUM-OF-REPS*  ),  WERE  NUM- 
OF-REPS  REPRESENTS  THE  NUMBER  CORRESPONDING  TO  THE  NUMBER  OF 
TIMES  THE  VALUE  IS  TO  BE  SUCCESSIVELY  REPEATED. 

INCLUDE  'COMMON. FTN' 

COMMON  /BUF/  lOBUFR(L.M) 

COMMON  /INBUF/  INTBUF(M) 

COMMON  /IMAGE/  IMCROU , IMGCOL 
COMMON  /FILE/  LUN 
LOGICAL*!  IOBUFR 
INTEGER  RECNUM 

WRITE  (6,*)  '***  ENTER  IMALG3  ***' 

LUNCR  -  LUN  +  1 
IF(LUNCR.EQ.5)LUNCR  -  7 
IF(LUNCR.GT. 10)LUNCR  -  1 
CALL  ASSIGN(LUNCR,'CR:') 

TYPE  ' 

TYPE  *,'***  PLEASE  CHECK  TO  SEE  IF  THE  CARD  READER  IS  READY  ***' 
TYPE  ' 

TYPE  1 

FORMAT( 5X, ' IF  READY,  TYPE  GO:',$) 

ACCEPT  2, GO 
FORMAT(A2) 

DO  20  RECNUM- l.IMCROW 

***  INPUT  THE  IMAGE  DATA  FROM  THE  CARD  READER  *** 

READ  (LUNCR, * , END-20, ERR-1 00) (IOBUFR( 1 , J) , J-l , IMGCOL) 

***  PERFORM  BYTE  TO  WORD  NUMBER  CONVERSION  *** 

DO  5  J-l, IMGCOL 
INTBUF(J)  -  IOBUFR( 1 , J) 

IF ( INTBUF ( J ) . LT. 0) INTBUF ( J )  -  INTBUF(J)  +  256 
CONTINUE 

***  WRITE  TO  LINE  PRINTER  *** 

WRITE  (6,*)  'RECORD  NUMBER' .RECNUM, ' 

WRITE  (6,9) 


221 


l 


t 

5 


i 


* 


anno 


D9  FORMAT( 1X,24( )) 

n  WRITE  (6,10)(INTBUF(J),J-1,IMCCOL) 

DIO  FORMAT(26(2X,  13 )) 

WRITE  (6,*)  '  ' 

***  OUTPUT  EACH  RECORD  TO  THE  IMAGE  FILE  *** 

I  -  1 

CALL  OUTPUT(RECNUM, I, IMAERR) 

IF ( IMAERR. EQ . I )RETURN 
C 

20  CONTINUE 

RETURN 

100  TYPE  ' 

TYPE  *,'***  READ  ERROR  OCCU RED  IN  IMALG3  ON  LOGICAL  UNIT'.LUNCR, 
1'  ***' 

CALL  CLOSDL( IMAERR) 

IMAERR  *  1 

RETURN 

END 


SUBROUTINE  IMALG4 (IMAERR) 

TYPE  *,'***  IMALG4  MOT  AVAILABLE  AT  THIS  TI?*E  ***' 
TYPE  ' 

TYPE  *,'***  [WARNING]:  NO  IMAGE  WAS  CREATED  ***' 
TYPE  ' 

RETURN 

EOT 


SUBROUTINE  IMALG5C IMAERR) 

TYPE  *,'***  IMALG5  NOT  AVAILABLE  AT  THIS  TLMF.  ***' 
TYPE  ' 

TYPE  *,'***  [WARNINC]:  NO  IMAGE  WAS  CREATED  ***' 
TYPE  ' 

RETURN 

END 
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SUBROUTINE  INPUT(RECNUM, I , INPERP) 


THIS  SUBROUTINE  INPUTS  A  ROW  OF  INTENSITY  DATA  INTO  THE  I/O 
BUFFER  ONE  RECORD  LONG. 

INCLUDE  'COMMON. FTN' 

COMMON  /BUF/  IOBUFR(L.M) 

COMMON  /IMAGE/  IX.IMGCOL 
COMMON  /FILE/  LUN 
LOGICAL* 1  IOBUFR 
INTEGER  RECNUM 

***  READ  THE  IMAGE  INTENSITY  DATA  FROM  THE  IMAGE  FILE  *** 

READ  ( LUN' RECNUM , END- 1 0 , ERR- 1 00 ) ( IOBUFR( I , J ) , J- 1 , IMGCOL) 

CONTINUE 
RETURN 
100  TYPE  *,  '  ' 

TYPE  *,'***  READ  ERROR  OCCURED  IN  INPUT  ON  LOGICAL  UNIT', LUN, 
1'  ***' 

CALL  CLOSKP(INPERR) 

INPERR  -  1 

WRITE  (6,*)  '***  EXIT  INPUT  -  READ  ERROR  TERMINATION  ***' 

RETURN 

END 
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SUBROUTINE  OUTPUT(RECNUM,  I  .OUTEP.R) 

C 

THIS  SUBROUTINE  OUTPUTS  A  ROW  OF  INTENSITY  DATA  ONE  RECORD 
LONG  TO  THE  OUTPUT  FILE  SPECIFIED. 

INCLUDE  '  COMMON. FTN' 

COMMON  /BUF/  IOBUFR(L.M) 

COMMON  /IMAGE/  IX.IMGCOL 
COMMON  /FILE /  LUN 
LOGICAL*!  IOBUFR 
INTEGER  RECNUM .OUTERR 

***  WRITE  INTENSITY  VALUES  TO  THE  IMAGE  FILE  *** 

WRITE  (LUN' RECNUM , ERR"100) (IOBUFR(I , J) , J*1 , IMCCOL) 

C 

RETURN 

100  TYPE  ' 

TYPE  *,'***  WRITE  ERROR  OCCURED  IN  OUTPUT  ON  LOGICAL  UNIT', LUN, 
1'  ***' 

CALL  CLOSDL(OUTERR) 

OUTERR  -  1 

WRITE  (6,*)  '***  EXIT  OUTPUT  -  WRITE  ERROR  TERMINATION  ***' 

RETURN 

END 
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SUBROUTINE  OP  NNEW  (OPtJERR) 

THIS  SUBROUTINE  OPENS  A  NEW  FILE  DEFINED  BY  THE  LOGICAL  UNIT 
NUMBER  AND  FILENAME  PREVIOUSLY  ENTERED. 

COMMON  /FILE/  LUN, IX,FNAME( 34) 

COMMON  /IMAGE/  IMGROW, IMGCOL 
LOCICALM  FNAME 
INTEGER  OPNERR 
RECCOL  -  IMGCOL/4.0 
IMGREC  -  IMCCOL/4 
REMNDR  -  RECCOL  -  FLOAT( IMGREC) 

IF(REMNDR.NE.O.O)IMGREC  -  IMGREC  +  1 

***  OPEN  THE  FILE  DEFINED  BY  THE  LOGICAL  UNIT  NUMBER  AND  FILENAME 
PREVIOUSLY  ENTERED  *** 

OPEN(UNIT-LUN,NA.*fE-FNAME,  DISPOSE-  'KEEP '  .ACCESS-'DIRECT' , 

1  ORGANIZATION” ' SEQUENTIAL' .TYPE -'UNKNOWN' , RECORDS IZE-IMGREC, 

2  MAXREC- IMGROW, BLOCKSIZE-IMGREC, INITIALSIZE-IMGROW.ERR-IOO, 

3  FORM- ' UNFO RMATTED ' ) 

C 

C  THE  FILE  OPENED  ABOVE  IS  STRUCTURED  AS  AN  UNFORMATTED  DIRECT 

C  ACCESS  SEOUENTIAL  FILE.  THE  LENGTH  OF  EACH  FILE  RECORD  IS 

C  DETERMINED  BY  THE  NUMBER  OF  COLUMNS  OF  THF.  IMAGE  TO  BE  OUTPUT. 

C  THE  NUMBER  OF  RECORDS  IN  THE  FILE  IS  DETERMINED  RY  THE  NUMBER 

C  OF  ROWS  OF  THE  IMAGE  TO  BE  OUTPUT.  THESE  PARAMETERS  WERE  INPUT 

C  IN  SUBROUTINE  IMSZE. 

C 

RETURN 

100  TYPE  ' 

TYPE  *,'***  OPEN  ERROR  OCCURED  IN  OPNNEW  ON  LOGICAL  UNIT', LUN, 

1'  ***' 

CALL  CLOSDL(OPNERR) 

OPNERR  -  1 

WRITE  (6,*)  '***  EXIT  OPNNEW  -  OPEN  ERROR  TERMINATION  ***' 

RETURN 

END 
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SUBROUTINE  OPNOLD(OPNERR) 


C 

C  THIS  SUBROUTINE  OPENS  AN  OLD  FILE  DEFINED  BY  THE  LOGICAL  UNIT 

C  NUMBER  AND  FILENAME  PREVIOUSLY  ENTERED. 

C 

COMMON  /FILE/  LUN, IX, FNAME( 34) 

COMMON  /IMAGE/  IMGROW, IMGCOL 

LOGICAL* 1  FNAME 

INTEGER  OPNERR 

RECCOL  -  IMGCOL/4.0 

IMCREC  -  IMGCOL/ 4 

REMNDR  -  RECCOL  -  FLOAT( IMGREC) 

IF(REMNDR.NE.O.O)IMGREC  -  IMGREC  +  1 
C 

C  ***  OPEN  THE  FILE  DEFINED  BY  THE  LOGICAL  UNIT  NUMBER  AND  FILENAME 

C  PREVIOUSLY  ENTERED  *** 

C 

OPEN(UNIT-LUN, NAME -FNAME, DISPOSE- 'KEEP ' .ACCESS3 'DIRECT' , 

1  ORGANIZATION* 'SEQUENTIAL ' ,TYPE«'OLD' ,RECORDSIZE"IMGREC, 

2  MAXR EC- IMGROW,  BLOCKSIZE-IMCREC,  INITIALSIZE-IMGROW,  F.RR-IOO, 

3  FORM- ' UNFORMATTED ' ) 

THE  FILE  OPENED  ABOVE  IS  STRUCTURED  AS  AN  UNFORMATTED  DIRECT 
ACCESS  SEQUENTIAL  FILE.  THE  LENGTH  OF  EACH  FILE  RECORD  IS 
DETERMINED  BY  THE  NUMBER  OF  COLUMNS  OF  THE  IMAGE  TO  BE  INPUT. 

THE  NUMBER  OF  RECORDS  IN  THE  FILE  IS  DETERMINED  BY  THE  NUMBER 
OF  ROWS  OF  THE  IMAGE  TO  BE  INPUT.  THESE  PARAMETERS  WERE  INPUT 
IN  SUBROUTINE  IMSZE. 

RETURN 
100  TYPE  *,'  ' 

TYPE  *,'***  OPEN  ERROR  OCCURF.D  IN  OPNOLD  ON  LOGICAL  UNIT' , LUN, 

1'  ***' 

CALL  CLOSKP(OPNERR) 

OPNERR  -  1 

WRITE  (6,*)  '***  EXIT  OPNOLD  -  OPEN  ERROR  TERMINATION  ***' 

RETURN 

END 
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SUBROUTINE  CLOSKP(CLSERR) 


I 

I 

1 


1 


C 

C  THIS  SUBROUTINE  CLOSES  THE  FILE  PREVIOUSLY  ASSIGNED  TO  LOGICAL 

C  UNIT  NUMBER  LUN,  THEN  KEEPS  IT. 

C 

COMMON  /FILE/  LUN 
INTEGER  CLSERR 
C 

C  ***  CLOSE  THE  FILE  PREVIOUSLY  OPENED  *** 

C 

CLOSE (UNIT-LUN, DISPOSE- ' KEEP ' , ERR- 1 00 ) 

C 

RETURN 

100  TYPE  ' 

TYPE  *,'***  CLOSE  ERROR  OCCURED  IN  CLOSKP  ON  LOGICAL  UNIT', LUN, 
1'  ***' 

CLSERR  -  1 

WRITE  (6,*)  '***  EXIT  CLOSKP  -  CLOSE  ERROR  TERMINATION  ***’ 

RETURN 

END 


i  r. 

:  I 
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SUBROUTINE  CLOSDL(CLSERR) 

THIS  SUBROUTINE  CLOSES  THE  FILE  PREVIOUSLY  ASSIGNED  TO  LOGICAL 
UNIT  NUMBER  LUN,  THEN  DELETES  IT. 

COMMON  /FILE/  LUN 
INTEGER  CLSERR 

***  CLOSE  THE  FILE  PREVIOUSLY  OPENED  *** 

aOSE(UMIT* LUN, DISPOSE* 'DELETE' , ERR*100) 

C 

RETURN 

100  TYPE  ' 

TYPE  *,'***  CLOSE  ERROR  OCCURED  IN  CLOSDL  ON  LOGICAL  UNIT' , LUN, 
1'  ***' 
as  ERR  -  1 

WRITE  (6,*)  '***  EXIT  CLOSDL  -  CLOSE  ERROR  TERMINATION  ***' 

RETURN 

END 
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Appendix  D_:  Interesting  Point  Selection  Section 


This  appendix  contains  the  FORTRAN  source  listings  for  the  Interesting 
Point  Selection  Section  of  program  DIDA. 


SUBROUTINE  INTPTS(INT, INTERR, INTEND) 

C 

C  THIS  SUBROUTINE  IS  USED  TO  OBTAIN  THE  INTERESTING  POINTS  OF 

C  THE  SELECTED  IMAGE.  THE  IMAGE  SIZE  IS  DEFINED  FIRST.  NEXT, 

C  THE  SIZE  OF  THE  WINDOW  USED  FOR  PROCESSING  IS  DEFINED.  THE 

C  THE  SELECTED  IMACE  IS  THEN  INPUT.  FINALLY,  THE  INTEREST  OPER- 

C  ATOR  TO  BE  USED  TO  FIND  THE  INTERESTING  POINTS  IS  SELECTED 

C  AND  PROCESSING  BEGINS.  WHEN  COMPLETE,  THE  LOCATION  OF  THE 

C  INTERESTING  POINTS  0N  THE  SELECTED  IMAGE  AND  THEIR  CORRESPOND- 

C  INC  VALUE,  TYPE,  AND  CORRELATION  WINDOW  ARE  STORED  OH  AN 

C  EXTERNAL  FILE  IF  THE  USER  DESIRES.  THESE  POINTS  ARE  ALSO 

C  LISTED  ON  THE  LINE  PRINTER  IF  THE  USER  DESIRES. 

C 

COMMON  /IOP/  IX, IPFLAG 
D  WRITE  (6,*)  '***  ENTER  INTPTS  ***' 

IPFLAG  -  0 
C 

C  ***  DEFINE  THE  IMAGE  SIZE  *** 

C 

CALL  IMGSZE 
C 

C  ***  DEFINE  THE  WINDOW  SIZE  *** 

C 

CALL  WNDSZE 
C 

C  ***  INPUT  THE  SELECTED  IMAGE  *** 

C 

CALL  IMGIN(INT, INTERR) 

IF (INTERR. EQ . 1 )RETURN 
C 

C  ***  TEST  FOR  STORAGE  *** 

C 

TYPE  *,'  ' 

TYPE  *,  'DO  YOU  WISH  TO  STORE  THE  INTERESTING  POINTS  ON  AN' 

TYPE  *, 'OUTPUT  FILE?' 

TYPE  *, ' IF  YOU  DO,  TYPE  YES.  OTHERWISE,  TYPE  NO.' 

TYPE  *,'  ' 

TYPE  1 

1  FORMAT(5X, 'ANSWER  - 
ACCEPT  2, ANSWER 

2  FORMAT (A3 ) 

CALL  ANSCHK( ANSWER) 
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IF(ANSWER.EQ.'NO')CO  TO  10 
IPFLAG  -  1 
C 

C  ***  DEFINE  THE  CORRELATION  WINDOW  SIZE  *** 

C 

CALL  CWDSZE 
C 

C  ***  OPEN  THE  CORRELATION  WINDOW  SCRATCH  FILE  *** 

C 

CALL  OPNCWF(INTERR) 

IF  ( INTERR.  EQ .  1  )RF,TURN 
C 

C  ***  SELECT  THF,  INTEREST  OPERATOR  FOR  PROCESSING  *** 

C 

10  CALL  IOPSEL(INT, INTERR, INTEND) 

IF( INTERR. EQ . 1 ) RETURN 
IF ( INTEND . EQ . 1 ) RETURN 
IF(ANSWER.EQ. 'NO' )G0  TO  20 
C 

C  ***  ENTER  THE  LOGICAL  UNIT  NUMBER  AND  FILE  NAME  FOR  STORING 

C  THE  INTERESTING  POINTS  *** 

C 

TYPE  *,'  ' 

TYPE  *, 'PLEASE  ENTER  THE  LOGICAL  UNIT  NUMBER  AND  FILE  NAME  FOR  THF/ 
TYPE  *, 'FILE  YOU  WISH  TO  USE  TO  STORE  THE  INTERESTING  POINTS:' 

CALL  IF 1 FLU 
C 

C  ***  OUTPUT  THE  INTERESTING  POINTS  *** 

C 

CALL  IPSOUT( INTERR) 

IF (INTERR. EQ . 1 )RETURN 
C 

C  ***  TEST  FOR  LISTINC  *** 

C 

20  TYPE  *,'  ' 

TYPE  *, 'DO  YOU  WISH  TO  LIST  THE  INTERESTING  POINTS  ON  THE' 

TYPE  *, 'LINE  PRINTER?' 

TYPE  *, 'IF  YOU  DO,  TYPE  YES.  OTHERWISE,  TYPE  NO.' 

TYPE  ' 

TYPE  1 

ACCEPT  2, ANSWER 
CALL  ANSCHK( ANSWER) 

IF ( ANSWER. F.Q.  'NO'  )RETURN 
C 

C  ***  LIST  THE  INTERESTING  POINTS  *** 

C 

CALL  IPLST 
C 

RETURN 

END 
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n  n  n  o  n  n  non 


SUBROUT INF  WNDSZE 


C 

C  THIS  SUBROUTINE  ALLOWS  THE  USER  TO  DETERMINE  THE  NUMBER  OF 

C  ROWS  AND  COLUMNS  OF  THE  WINDOW  TO  BE  MOVED  ACROSS  THE  IMAGE. 

C  FROM  THIS,  THE  WINDOW  SIZE  AND  ITS  INVERSE  MAY  BE  OBTAINED. 

C  THE  USER  IS  ASKED  TO  CHECK  THE  INPUT  INFORMATION  AND  MAKE 

C  CORRECTIONS  IF  NECESSARY. 

C 

COMMON  /WINDOW/  WNDROW.WNDCOL, IX, IY, WDSZE, WNDINV 
INTEGER  WNDROW,WNDCOL, WDSZE 
TYPE  ' 

TYPE  *, 'PLEASE  TYPE  THE  NUMBER  OF  ROWS  AND  COLUMNS' 

TYPE  *, 'OF  THE  WINDOW:' 

TYPE  *,'  ' 

***  ENTER  THE  NUMBER  OF  ROWS  AND  COLUMNS  OF  THE  WINDOW  *** 

CALL  VJRCFND 

***COMPUTE  THE  WINDOW  SIZE  (NUMBER  OF  ROWS  X  NUMBER  OF  COLUMNS)*** 
WDSZE  -  WNDROW*WNDCOL 

***  COMPUTE  THE  INVERSE  OF  THE  WINDOW  SIZE  *** 

WNDINV  -  l.O/WDSZE 
C 

WRITE  (6,*)  '  ' 

WRITE  (6,*)  '***  WINDOW  INFORMATION  ***' 

WRITE  (6,*)  '  ' 

WRITE  (6,*)  'NUMBER  OF  WINDOW  ROWS  -  ' , WNDROW 
WRITE  (6,*)  'NUMBER  OF  WINDOW  COLUMNS  ■  '.WNDCOL 
WRITE  (6,*)  'WINDOW  SIZE  (ROWSXCOLUMNS)  -  '.WDSZE 
WRITE  (6,*)  'INVERSE  OF  WINDOW  SIZE  -  '.WNDINV 
WRITE  (6,*)  '  ' 

RETURN 

END 
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SUBROUTINE  WRCFND 


C 

C  THIS  SUBROUTINE  ALLOTS  THE  USER  TO  ENTER  THE  NUMBER  OF  ROWS  AND 

C  COLUMNS  INTERACTIVELY  FOR  THE  WINDOW  TO  BE  MOVED  ACROSS  THE  IM- 

C  AGE.  THE  USER  MAY  CORRECT  THIS  INFORMATION  IF  AH  ENTRY  ERROR 

C  OCCURS. 

C 

C 

C  ***  ENTER  THE  NUMBER  OF  ROWS  AND  COLUMNS  *** 

C 

CALL  WDROW 
CALL  WDCOL 

***  OPTIONAL  ENTRY  INFORMATION  CHECK  *** 

TYPE  ' 

TYPE  *,'DO  YOU  WISH  TO  CHECK  FOR  ENTRY  ERRORS?' 

TYPE  ' IF  YOU  DO,  TYPE  YES.  OTHERWISE,  TYPE  NO.' 

TYPE  ' 

TYPE  1 

FORMAT( 5X, 'ANSWER  -  ',$) 

ACCEPT  2, ANSWER 
FORMAT! A3) 

***  CHECK  ANSWER  ENTRY  *** 

CALL  AN SCHK( ANSWER) 

IF!ANSWER.EQ.'NO')GO  TO  3 

***  CHECK  ENTRY  INFORMATION  *** 

CALL  WRCCHK 
C 

3  RETURN 

END 
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SUBROUTINE  WRCCHK 


C 

C  THIS  SUBROUTINE  ALLOWS  THE  USER  TO  CHECK  THE  INFORJ1ATION 

C  INPUT  FOR  THE  NUMBER  OF  ROWS  AND  COLUMNS  OF  THE  WINDOW,  AND 

C  TO  CORRECT  THEM  IF  DESIRED. 

C 

COMMON  /WINDOW/  WNDROW .WNDCOL 
INTEGER  WNDROW, WNDCOL 

1  TYPE  ' 

TYPE  *, 'HERE  IS  WHAT  YOU  HAVE  INPUT:' 

TYPE  ' 

C 

C  ***  DISPLAY  THE  NUMBER  OF  WINDOW  ROWS  AND  COLUMNS  *** 

C 

TYPE  *, 'NUMBER  OF  WINDOW  ROWS  -  ' , WNDROW 
TYPE  *, 'NUMBER  OF  WINDOW  COLUMNS  -  '.WNDCOL 
C 

C  ***  VERIFY  THE  CORRECT  RESPONSE  *** 

C 

CALL  VERIFY (ANSWER) 

C 

IF(ANSWER.EQ. 'YES' )GO  TO  2 
C 

C  ***  CHANGE  INCORRECT  INFORMATION  *** 

C 

CALL  WRCCOR 
C 

GO  TO  I 

2  RETURN 
END 


o  r*  n  to  o  n  o  ►-  n  o  n  n>  *—  o  o  o  noon 


SUBROUTINE  WROCOR 


THIS  SUBROUTINE  ALLOWS  THE  USER  TO  CORRECT  THE  INFORMATION 
INPUT  FOR  THE  NUMBER  OF  WINDOW  ROWS  AND  COLUMNS. 

REAL  ITEM 

***  MAKE  ERROR  CORRECTIONS  *** 

TYPE  *, '  ' 

TYPE  *,'DO  YOU  WANT  TO  CHANGE  THE  NUMBER  OF  ROWS,  COLUMNS,' 

TYPE  *, 'OR  BOTH?' 

TYPE  *, 'IF  YOU  WANT  TO  CHANGE  THE  NUMBER  OF  ROWS,  TYPE  ROWS.' 

TYPE  * , ' IF  YOU  WANT  TO  CHANGE  THE  NUMBER  OF  COLUMNS,  TYPE  COLS.' 

TYPE  *,'IF  YOU  WANT  TO  CHANGE  BOTH,  TYPE  BOTH.' 

TYPE  ' 

TYPE  2 

FORMAT(5X, 'ITEM  YOU  WISH  TO  CHANGE  -  ',$) 

ACCEPT  3, ITEM 
FORMAT(A4) 

IF(ITEM.EQ. 'BOTH' )GO  TO  10 
IF ( ITEM. EO. 'ROWS' )G0  TO  20 
IF( ITEM. EQ. 'COLS' )G0  TO  30 
TYPE  *,'  ' 

TYPE  *,'***  ITEM  ENTRY  ERROR  -  PLEASE  RETYPE  ***' 

TYPE  *,'  ' 

GO  TO  1 

***  CHANGE  BOTH  NUMBER  OF  ROWS  AND  COLUMNS  *** 

CALL  WDROW 
CALL  WDCOL 
RETURN 

***  CHANGE  NUMBER  OF  ROWS  *** 

CALL  WDROW 
RETURN 

***  CHANGE  NUMBER  OF  COLUMNS  *** 

30  CALL  WDCOL 

RETURN 
END 
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SUBROUTINE  WDROW 


C  THIS  subroutine  allows  the  user  to  input  thf.  number  of  rows 

c  OF  THE  WINDOW  TO  BE  MOVED  ACROSS  THE  IMACE. 

C 

INCLUDE  'COMMON. FTN' 

COMMON  /WINDOW/  WNDROW 
INTEGER  WNDROW 
I  -  2*N  -  I 
C 

C  ***  ENTER  THE  NUMBER  OF  WINDOW  ROWS  *** 

C 

TYPE  1 

1  FORMAT(5X, 'NUMBER  OF  WINDOW  ROWS  =  ',$) 

ACCEPT  * , WNDROW 

IF ( WNDROW. GT. I )GO  TO  2 
IF(WNDROW.LT.2)GO  TO  3 
C 

RETURN 

2  TYPE  ' 

TYPE  *,'***  MAXIMUM  WINDOW  ROW  SIZE', I,'  EXCEEDED  IN  WDROW  *** 
GO  TO  4 

3  TYPE  *, '  ' 

TYPE  *,'***  ROW  SIZE  SMALLER  THAN  2  (MINIMUM)  ATTEMPTED  ***' 

C 

c  ***  CORRECT  ROW  SIZE  *** 

C 

4  CALL  WRCCOR 

C 

IF ( WNDROW . GT . I )GO  TO  2 
IF (WNDROW  LT. 2 )GO  TO  3 
RETURN 
END 
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SUBROUTINE  WDCOL 


THIS  SUBROUTINE  ALLOWS  THE  USER  TO  INPUT  THE  NUMBER  OF  COLUMNS 
OF  THE  WINDOW  TO  BE  MOVED  ACROSS  THE  IMACE. 

COMMON  /IMAGE/  X.IMCCOL 
COMMON  /WINDOW/  XX,  WNDCOL 
INTEGER  WNDCOL, X, XX 
N  -  IMGCOL  -  1 

***  ENTER  THE  NUMBER  OF  WINDOW  COLUMNS  *** 

TYPE  1 

FORMAT( 5X, 'NUMBER  OF  WINDOW  COLUMNS  «  ',S) 

ACCEPT  *, WNDCOL 

IF( WNDCOL. GT. N)GO  TO  2 

IF (WNDCOL. LT. 2 )GO  TO  3 

RETURN 
TYPE  ' 

TYPE  *,'***  MAXIMUM  WINDOW  COLUMN  SIZE'.N,'  EXCEEDED  IN  WDCOL  ***' 
GO  TO  4 
TYPE  ' 

TYPE  *,'***  COLUMN  SIZE  LESS  THAN  2  (MINIMUM)  ATTEMPTED  ***' 

***  CORRECT  COLUMN  SIZE  *** 

CALL  WRCCHK 

IF(WNDCOL.GT.N)GO  TO  2 
IF(WNDCOL,LT.2)GO  TO  3 
RETURN 
END 
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SUBROUTINE  IMGIN(INT,  IMGERR) 


THIS  SUBROUTINE  INPUTS  IMAGE  INTENSITY  DATA  INTO  THE  INTENSITY 
ARRAY  ONE  ROW  AT  A  TIME.  THE  NUMBER  OF  ROWS  INPUT  IS  EQUAL  TO 
THE  NUMBER  OF  WINDOW  ROWS  SPEGIFIED.  THE  I/O  BUFFER  IS  THEN 
FILLED  WITH  L  MORE  ROWS  OF  INTENSITY  DATA.  THE  LOGICAL  UNIT 
NUMBER  AND  FILENAME  OF  THE  IMAGE  TO  BE  INPUT  ARE  ENTERED  INTER¬ 
ACTIVELY,  AND  THE  USER  MAY  CORRECT  THEM  IF  AN  ENTRY  ERROR  OCCURS. 

INCLUDE  'COMMON. FTN' 

VIRTUAL  INT(2*N,M) 

COMMON  /BUF/  IOBUFR(L.M) 

COMMON  /IMAGE/  IMGROW , IMGCOL 

COMMON  /WINDOW/  WNDROW 

COMMON  /COUNT/  X.XX.RECNUM 

LOGICALM  IOBUFR 

INTEGE R  R  SCNUM , WNDROW , X , XX 

WRITE  (6,*)  '***  ENTER  IMG IN  ***' 

***  ENTER  THE  LOGICAL  UNIT  NUMBER  AND  FILE  NAME  *** 

TYPE  ' 

TYPE  *, 'PLEASE  ENTER  THE  LOGICAL  UNIT  NUMBER  AND  FILE  NAME  FOR' 
TYPE  *, 'THE  FILE  CONTAINING  THE  IMAGE  TO  BE  PROCESSED:' 

CALL  FLUFND 

***  OPEN  THE  FILE  DEFINED  BY  THE  LOCICAL  UNIT  NUMBER  AND  FILENAME 
PREVIOUSLY  ENTERED  *** 

CALL  OPNOLD( IMGERR) 

IF ( IMGERR. EQ . I )RETURN 

DO  30  RECNUM-1, WNDROW 

***  READ  THE  ’MACE  INTENSITY  DATA  INTO  THE  10  BUFFER  *** 

I  -  1 

CALL  IN?UT(RECNUM, I, IMGERR) 

IF  ( IMGERR.  F.0 . 1 )  RETURN 

***  PERFORM  BYTE  TO  WORD  NUMBER  CONVERSION  *** 

DO  10  J-l, IMGCOL 
INT(RECNUM.J)  -  I0BUFR(1,J) 

IF(INT(RECNUM, J).LT.O)INT(RECNUM, J)  -  INT(RECNUM, J)  +  256 
CONTINUE 

***  WRITE  TO  LINE  PRINTER  *** 
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WRITE  (6,*)  'RECORD  NUMBER' .RECNUM, '  :' 
WRITE  (6,15) 

15  F0RMAT(1X,24('-')) 

WRITE  (6,20)(INT(RECNUM, J), J*1 , IMGCOL) 
20  FORMAT(26(2X, 13)) 

WRITE  (6,*)  '  ' 

0  CONTINUE 

***  FILL  I/O  BUFFER  *** 

CALL  BUFRIN(IMCERR) 

RETURN 

END 
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SUBROUTINE  CWDSZE 
C 

C  THIS  SUBROUTINE  ALLOWS  THE  USER  TO  DETERMINE  THE  NUMBER  OF 

C  ROWS  AND  COLUMNS  OF  THE  CORRELATION  WINDOW  ASSOCIATED  WITH 

C  EACH  INTERESTING  POINT.  THE  USER  IS  THEN  ASKED  TO  CHECK 

C  THE  INPUT  INFORMATION  AND  MAKE  CORRECTIONS  IF  NECESSARY. 

C 

COMMON  /CORVND/  CWDROW, CWDCOL, CWDRWH, CWDCLH, CWSZE, CWDINV 
INTEGER  CWDROW , CWDCOL , CWDRWH , CWDCLH , CWSZE 
TYPE  *,'  ' 

TYPE  *, 'PLEASE  TYPE  THE  NUMBER  OF  ROWS  AND  COLUMNS' 

TYPE  *,  'OF  THE  CORRELATION  WINDOW:' 

TYPE  *,'  ' 

C 

C  ***  ENTER  THE  NUMBER  OF  ROWS  AND  COLUMNS  OF  THE  WINDOW  *** 

C 

CALL  CRCFND 
C 

C  ***COMPUT5  THE  WINDOW  SIZE  (NUMBER  OF  ROWS  X  NUMBER  OF  COLUMNS)*** 

C 

CWSZE  -  CWOROW*CWDCOL 
CWDRWH  -  CWDROW / 2  +  1 
CWDCLH  -  CWDCOL/ 2  +  l 
C 

C  ***  COMPUTE  THE  INVERSE  OF  THE  WINDOW  SIZE  *** 

C 

CWDINV  -  1 .0 /CWSZE 
C 

WRITE  (6,*)  '  ' 

WRITE  (6,*)  '***  CORRELATION  WINDOW  INFORMATION  ***' 

WRITE  (6,*)  '  ' 

WRITE  (6,*)  'NUMBER  OF  CORRELATION  WINDOW  ROWS  -  ' , CWDROW 
WRITE  (6.*)  'NUMBER  OF  CORRELATION  WINDOW  COLUMNS  -  '.CWDCOL 
WRITE  (6,*)  'CORRELATION  WINDOW  SIZE  (ROWSXCOLtJMNS)  -  '.CWSZE 
WRITE  (6,*)  'INVERSE  OF  CORRELATION  WINDOW  SIZE  -  '.CWDINV 
WRITE  (6.*)  '  ' 

RETURN 

END 
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SUBROUTINE  CRCFND 


C 

C  THIS  SUBROUTINE  ALLOWS  THE  USER  TO  ENTER  THE  NUMBER  OF  ROWS  AND 

C  COLUMNS  INTERACTIVELY  FOR  THE  CORRELATION  WINDOW  ASSOCIATED  WITH 

C  EACH  INTERESTING  POINT.  THE  USER  MAY  CORRECT  THIS  INFORMATION 

C  IF  AN  ENTRY  ERROR  OCCURS. 

C 

C 

C  ***  ENTER  THE  NUMBER  OF  ROWS  AND  COLUMNS  *** 

C 

CALL  CWROW 
CALL  CWCOL 

***  OPTIONAL  ENTRY  INFORMATION  CHECK  *** 

TYPE  ' 

TYPE  *, 'DO  YOU  WISH  TO  CHECK  FOR  ENTRY  ERRORS?' 

TYPE  *, ' IF  YOU  DO,  TYPE  YES.  OTHERWISE,  TYPE  NO.' 

TYPE  *, '  ' 

TYPE  I 

FORHAT( 5 X, 'ANSWER  -  ',$) 

ACCEPT  2 .ANSWER 
FORMAT(A3) 

***  CHECK  ANSWER  ENTRY  *** 

CALL  ANSCHK( ANSWER) 

IF(ANSWER.EQ. 'NO' )GO  TO  3 

***  CHECK  ENTRY  INFORMATION  *** 

CALL  CRCCHK 
C 

3  RETURN 

END 
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SUBROUTINE  CRCCHK 


THIS  SUBROUTINE  ALLOWS  THE  USER  TO  CHECK  THE  INFORMATION 
INPUT  FOR  THE  NUMBER  OF  ROWS  AND  COLUMNS  OF  THE  CORRELATION 
WINDOW,  AND  TO  CORRECT  THEM  IF  DESIRED. 

COMMON  /CORWND/  CWDROW , CWDCOL 
INTEGER  CWDROW , CWDCOL 
TYPE  ' 

TYPE  *, 'HERE  IS  WHAT  YOU  HAVE  INPUT:' 

TYPE  ' 

***  DISPLAY  THE  NUMBER  OF  WINDOW  ROUS  AND  COLUMNS  *** 

TYPE  *, 'NUMBER  OF  CORRELATION  WINDOW  ROWS  -  '.CWDROW 
TYPE  *, 'NUMBER  OF  CORRELATION  WINDOW  COLUMNS  -  ' .CWDCOL 

***  VERIFY  THE  CORRECT  RESPONSE  *** 

CALL  VERIFY( ANSWER) 

IF(ANSWER. EQ. 'YES' )GO  TO  2 

***  CHANGE  INCORRECT  INFORMATION  *** 

CALL  CRCCOR 
C 

GO  TO  1 
2  RETURN 

END 
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SUBROUTINE  CRCCOR 


THIS  SUBROUTINE  ALLOTS  THE  USER  TO  CORRECT  THE  INFORMATION 
INPUT  FOR  THE  NUMBER  OF  CORRELATION  WINDOW  ROTS  AND  COLUMNS. 

REAL  ITEM 

***  MAKE  ERROR  CORRECTIONS  *** 

TYPE  ' 

TYPE  *,'DO  YOU  WANT  TO  CHANOE  THE  NUMBER  OF  ROWS,  COLUMNS,' 

TYPE  *, 'OR  BOTH?' 

TYPE  '  IF  YOU  WANT  TO  CHANGE  THE  NUMBER  OF  ROWS,  TYPE  ROWS.' 

TYPE  ' IF  YOU  WANT  TO  CHANGE  THE  NUMBER  OF  COLUMNS,  TYPE  COLS. 

TYPE  * , ' IF  YOU  WANT  TO  CHANGE  ROTH,  TYPE  BOTH.' 

TYPE  ' 

TYPE  2 

FORMAT(5X,'ITEM  YOU  WISH  TO  CHANGE  -  ',$) 

ACCEPT  3, ITEM 
FORMAT(A4) 

IF ( ITEM. EQ. 'BOTH' )GO  TO  10 
IF(ITEM.EQ. 'ROWS' )G0  TO  20 
IF(ITEM.EQ. 'COLS' )G0  TO  30 
TYPE  ' 

TYPE  *,'***  ITEM  ENTRY  ERROR  -  PLEASE  RETYPE  ***' 

TYPE  *,'  ' 

GO  TO  1 

***  CHANCE  BOTH  NUMBER  OF  ROWS  AND  COLUMNS  *** 

CALL  CWROW 
CALL  CWCOL 
RETURN 

***  CHANGE  NUMBER  OF  ROTS  *** 

CALL  CWROW 
RETURN 

***  CHANGE  NUMBER  OF  COLUMNS  *** 

CALL  CWCOL 

RETURN 

END 
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SUBROUTINE  CWROW 


THIS  SUBROUTINE  ALLOWS  THE  USER  TO  INPUT  THE  NUMBER  OF  ROWS 
OF  THE  CORRELATION  WINDOW. 

INCLUDE  'COMMON. FTN' 

COMMON  /CORWND/  CWDROW 
INTEGER  CWDROW 

***  ENTER  THE  NUMBER  OF  WINDOW  ROWS  *** 

TYPE  1 

FORMAT(5X, 'NUMBER  OF  CORRELATION  WINDOW  ROWS  -  ',S) 

ACCEPT  *, CWDROW 
IF ( CWDROW . GT . M/ 6 )G0  TO  2 
IF (CWDROW.LT. 2 )GO  TO  3 

RETURN- 
TYPE  ' 

TYPE  *,'***  MAXIMUM  WINDOW  ROW  SIZE', M/6,'  EXCEEDED  IN  CWROW  ***' 
GO  TO  A 
TYPE  ' 

TYPE  *,'***  ROW  SIZE  SMALLER  THAN  2  (MINIMUM)  ATTEMPTED  ***' 

***  CORRECT  ROW  SIZE  *** 

CALL  CRCCOR 

IF ( CWDROW .GT.M/6)G0  TO  2 
IF (CWDROW.LT, 2 )G0  TO  3 
RETURN 
END 

SUBROUTINE  CWCOL 

THIS  SUBROUTINE  ALLOWS  THE  USER  TO  INPUT  THE  NUMBER  OF  COLUMNS 
OF  THE  CORRELATION  WINDOW. 

INCLUDE  'COMMON. FTN' 

COMMON  /CORWND/  CWDROW, CWDCOL 
INTEGER  CWDROW, CWDCOL 

***  ENTER  THE  NUMBER  OF  WINDOW  COLUMNS  *** 

TYPE  1 

1  FORMAT( 5X, ' NUMBER  OF  CORRELATION  WINDOW  COLUMNS  -  ',$) 

ACCEPT  *, CWDCOL 
I  -  CWDROW*CWDCOL 
J  -  M/(3*CWDR0W) 

IF(I.CT.M/3)G0  TO  2 


2A3 


o  p*  o  n  o 


IF ( CWDCOL. LT . 2 )GO  TO  3 
C 

RETURN 

2  TYPE  ' 

TYPE  *,'***  MAXIMUM  WINDOW  COLUMN  SIZE'.J,'  EXCEEDED  IN  CWCOL  *** 
TYPE  *, 'PRESENT  WINDOW  COLUMN  SIZE  -  '.CWDCOL 
TYPE  ' 

TYPE  *, 'PRODUCT  OF  ROWS  AND  COLUMNS  CANNOT  EXCEED: ', M/3 
TYPE  *, 'PRESENT  PRODUCT  OF  ROWS  AND  COLUMNS  IS: '.I 
GO  TO  4 

3  TYPE  ' 

TYPE  *,'***  COLUMN  SIZE  LESS  THAN  2  (MINIMUM)  ATTEMPTED  ***' 

***  CORRECT  COLUMN  SIZE  *** 

CALL  CRCCHK 

I  -  CWDROW*CWDCOL 
J  -  M/(3*CWDROW) 

IF ( I . GT . M/ 3 )GO  TO  2 
IF(CWDCOL. LT.2)GO  TO  3 
RETURN 
END 
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SUBROUTINE  OPNCWF(OPNERR) 

THIS  SUBROUTINE  OPENS  A  SCRATCH  FILE  FOR  TEMPORARILY  STORING 
THE  CORRELATION  WINDOW  SURROUNDING  EACH  INTERESTING  POINT.  THE 
FILE  IS  A  SEQUENTIAL  FORMATTED  FILE  WITH  THE  DEFAULT  FILENAME. 

COMMON  /FILE/  LUN 
COMMON  /CWFILE/  LUNCW 
COMMON  /CORWND/  IA, IB ,IC , ID.CWDSZE 
INTEGER  OPNERR, CWDSZE 

***  DEFINE  THE  LOGICAL  UNIT  NUMBER  *** 

LUNCW  -  LUN  +  I 

IF ( LUNCW . EO . 5 ) L UNCW  -  7 

IF ( LUNCW . GT . 1 0 )LUNCW  -  1 

***  OPEN  THE  FILE  *** 

OPE N(UNIT*LUNCW, TYPE* 'SCRATCH' ,RECORDSIZE-3*CUDSZE+4 .ERR-100) 

RETURN 
TYPE  ' 

TYPE  *,'***  OPEN  ERROR  OCCURED  IN  OPNCWF  ON  LOGICAL  UNIT', LUNCW, 
}  '  ***' 

CLOSE(UNIT*LUNCW, DISPOSE* 'DELETE' ) 

CALL  CLOSKP(OPNERR) 

OPNERR  -  1 

WRITE  (6,*)  '***  EXIT  OPNCWF  -  OPEN  ERROR  TERMINATION  ***' 

RETURN 

END 
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SUBROUTINE  IOPSEL(INT, IOPERR, IOPEND) 


THIS  SUBROUTINE  ALLOWS  THE  USER  TO  SELECT  THE  INTEREST 
OPERATOR  TO  BE  USED  TO  FIND  THE  INTERESTING  POINTS  OF 
THE  SELECTED  IMAGE. 


COMMON  /IOP/  IOPNBR 
TYPE  *, 

'ENTER  THE  NUMBER  CORRESPONDING  TO  THE  INTEREST  OPERATOR' 
'YOU  WISH  TO  USE  TO  FIND  THE  INTERESTING  POINTS  OF  THE' 
'SELECTED  IMAGE:' 


TYPE  * 

TYPE  * 

TYPE  * 

TYPE  * 

TYPE  * 

TYPE  * 

TYPE  * 

TYPE  * 

TYPE  * 

TYPE  * 

TYPE  * 

TYPE  * 

TYPE  * 

TYPE  * 

TYPE  * 

TYPE  * 

TYPE  * 

TYPE  5 

FORMAT( 5X, '  INTEREST  OPERATOR  NUMBER  -  ',$) 

ACCEPT  *, IOPNBR 

IFCIOPNBR.LT. 1. OR. IOPNBR. GT. 12)G0  TO  200 

GO  T0( 10, 20, 30, 40, 50, 60, 70, 80, 90, 100, 110, 120)I0PNBR 

CALL  I0P1CINT, IOPERR) 

RETURN 

CALL  I0P2CINT, IOPERR) 

RETURN 


1.  SIMPLE  VARIANCE' 

2.  DIRECTED  VARIANCE' 

3.  EDGED  VARIANCE' 

4.  NONE  YET' 

5.  NONE  YET' 

6.  NONE  YET' 

7.  NONE  YF.T' 

8.  NONE  YET' 

9.  NONE  TFT' 

10.  NONE  YET' 

11.  TERMINATE  INTERESTING  POINT  PROCESSING' 

12.  TERMINATE  PROGRAM  EXECUTION' 


CALL  I0P3CINT, IOPERR) 
RETURN 

CALL  I0P4(I0PERR) 

GO  TO  1 

CALL  I0P5(I0PERR) 

GO  TO  1 

CALL  I0P6(I0PERR) 

GO  TO  1 

CALL  I0P7( IOPERR) 

GO  TO  1 

CALL  I0P8CI0PERR) 

GO  TO  1 

CALL  I0P9( IOPERR) 

GO  TO  1 
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CALL  I0P1 0( IOPERR) 

GO  TO  1 

CALL  CLOSKP(IOPERR) 

return 

I  OPEN'D  -  1 

CALL  CLOSKP(IOPEPR) 

RETURN 
TYPE  ' 

TYPE  *,'***  INVALID  INTEREST  OPERATOR  NUMBER' , IOPNBR, '  ATTEMPTED 
1***' 

GO  TO  1 


noo  o  o  n  a  k>  ►-  n  nn  ooo 


SUBROITTIMF  IF  1  FLU 


C 

C  THIS  SUBROUTINE  ALLOWS  THE  USER  TO  ENTER  THE  LOGICAL  UNIT 

C  NUMBER  AND  FILE  NAME  INTERACTIVELY  r0R  INTERESTING  POINT 

C  SET  INPUT/OUTPUT  OPERATIONS.  THE  USER  MAY  CORRECT  THIS 

C  INFORMATION  IF  AN  ENTRY  ERROR  OCCURS. 

C 

COMMON  /IFILEI/  LUN1 ,  NCHARI .  FNAME1  (  34) 

LOGICAL* 1  FNAME1 

***  ENTER  THE  LOGICAL  UNIT  NUMBER  AND  FILE  NAME  *** 

CALL  LUNBRI 
CALL  FILNM1 

***  OPTIONAL  ENTRY  INFORMATION  CHECK  *** 

TYPE  *,  '  ' 

TYPE  *, 'DO  YOU  WISH  TO  CHECK  FOR  ENTRY  ERRORS?' 

TYPE  ' IF  YOU  DO,  TYPE  YES.  OTHERWISE,  TYPE  NO.' 

TYPE  ' 

TYPE  1 

FORMAT(5X, 'ANSWER  *  ',$) 

ACCEPT  2, ANSWER 
FORMAT(A3) 

***  CHECK  ANSWER  ENTRY  *** 

CALL  AN SCHK( ANSWER) 

IF(AHSWER.EQ. 'NO' )GO  TO  3 

***  CHEGK  ENTRY  INFORMATION  *** 

CALL  IF1CHK 
C 

3  WRITE  (6,*)  '  ' 

'.'/RITE  (6,*)  ’***  INTERESTING  POINT  SET  1  FILE  INFORMATION  ***' 
WRITE  (6,*)  '  ' 

WRITE  (6,*)  'LOGICAL  UNIT  NUMBER  -  ',LUN1 
WRITE  (6,4)  (FNAME1 (I ),I-1, NCHARI) 

4  FORIfATC  IX, 'FILENAME  -  '  ,<NCHARI+1>A1 ) 

WRITE  (6,*)  '  ' 

RETURN 

END 
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SUBROUTINE  IF1CHK 


C 

THIS  SUBROUTINE  ALLOWS  THE  USER  TO  CHECK  THE  INFORMATION 
INPUT  FOR  THE  FILE  NAME  AND  LOGICAL  UNIT  NUMBER,  AND  TO 
CORRECT  THEM  IF  DESIRED. 

COMMON  /IFILE1 /  LUN 1 , NCHAR 1 , FNAME 1(34) 

LOGICAL* 1  FNAME 1 
TYPE  ' 

TYPE  *,  'HERE  IS  ’.THAT  YOU  HAVE  INPUT:' 

TYPE  *,'  ' 

***  DISPLAY  THE  FILE  NA'IE  AND  LOGICAL  UNIT  NUMBER  INPUT  ** 

TYPE  *, 'LOGICAL  UNIT  NUMBER  -  #,LUN1 
TYPE  2 , ( FNAME 1(1), 1=1, NCHAR 1 ) 

FORMATC IX, 'FILENAME  =  ' ,<NCHAR1+1 >A1 ) 

***  VERIFY  THE  CORRECT  RESPONSE  *** 

CALL  VF.RIFY( ANSWER) 

IF (ANSWER. EQ. 'YES' )GO  TO  3 

***  CHANCE  INCORRECT  INFORMATION  *** 

CALL  IF1COR 
C 

GO  TO  1 
3  RETURN 

END 
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SUBROUTINE  IF1COR 


C 

C 

C 

C 

C 

C 

C 


1 


2 

3 


C 

C 

C 

10 


C 

C 

C 

20 


THIS  SUBROUTINE  ALLOWS  THE  USER  TO  CORRECT  THE  INFORMATION 
INPUT  FOR  THE  FILE  NAME  AND  LOGICAL  UNIT  NUMBER. 


REAL  ITEM 


***  MAKE  ERROR  CORRECTIONS  *** 


TYPE  * 
TYPE  * 
TYPE  * 
TYPE  * 
TYPE  * 
TYPE  * 
TYPE  * 
TYPE  2 


'DO  YOU  WANT  TO  CHANGE  THE  LOGICAL  UNIT  NUMBER,' 

'FILE  NAME,  OR  BOTH?' 

'IF  YOU  WANT  TO  CHANGE  THE  LOGICAL  UNIT  NUMBER,  TYPE  LUN. 
'IF  YOU  WANT  TO  CHANGE  THE  FILE  NAME,  TYPE  FILE.' 

'IF  YOU  WANT  TO  CHANGE  BOTH,  TYPE  ROTH.' 


F0RMAT(5X, 'ITEM  YOU  WISH  TO  CHANGE  =  ',S) 

ACCEPT  3, ITEM 
F0RMAT(A4) 

IF( ITEM. EO. 'BOTH' )C0  TO  10 
IF(ITEM.E(j.  'LUN'  )G0  TO  20 
IF ( ITEM. EO. 'FILE' )G0  TO  30 
TYPE  ' 

TYPE  *,'***  ITEM  ENTRY  ERROR  -  PLEASE  RETYPE  ***' 
TYPE  ' 

GO  TO  1 


***  CHANGE  BOTH  FILE  NAME  AND  LOGICAL  UNIT  NUMBER  *** 


CALL  FILNM1 
CALL  LUNBR1 
RETURN 

***  CHANGE  LOGICAL  UNIT  NUMBER  *** 


CALL  I.UNBR1 
RETURN 


C 

C  ***  CHANGE  FILE  NAME  *** 

C 

30  CALL  FILNM1 

RETURN 
END 


2  50 
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SUBROUTINE  FILNM1 


C 


C 

C 


C 

C 

C 

1 

2 
C 


THIS  SUBROUTINE  ALLOWS  THE  USER  TO  INPUT  THE  FILE  NAME  OF 
THE  FILE  BEING  USED  FOR  INTERESTING  POINT  SET  INPUT/OUTPUT 
OPERATIONS. 


COMMON  /IFILE1/  IX.NCHAR1 ,FNAME1(34) 

LOGICAL*!  FNAME1 
TYPE  ' 

TYPE  *,'WHAT  DEVICE/UIC/FILENA!fE  DO  YOU  WISH  TO  USE?' 
TYPE  *, 'ENTER  ACCORDING  TO  THE  FOLLOWING  FORMAT : ' 


TYPE  *, '  ' 

TYPE  DEV : [  UIC  ] FILENAME. TYPE; VERSION' 

TYPE  *, 'EXAMPLE:  DK1 : [ 10, 20] FILENAME. IMG; 3' 

TYPE  *, '  ' 


***  INPUT  THE  DESIRED  FILE  NAME  *** 


TYPE  . 

F0RMAT(5X, 'FILENAME  -  ',$) 
ACCEPT  2 ,  NCHAR 1 ,  FNAMF.  1 
FORMAT(Q ,  34A1 ) 

FNA'IEl  (NCHAR  1+1)  *  0 

RETURN 

END 
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SUBROUTINE  LUNBR1 


THIS  SUBROUTINE  ALLOWS  THE  USER  TO  INPUT  THE  LOGICAL  UNIT 
NUMBER  ASSOCIATED  WITH  THE  FILE  TO  BE  USED  FOR  INTERESTING 
POINT  SET  INPUT/OUTPUT  OPERATIONS. 

COMMON  /CWFILE/  LUNCN 
COMMON  /IFILE1/  LUN1 
TYPE  *, '  ' 

TYPE  *,'WHAT  LOGICAL  UNIT  NUMBER  YOU  WISH  TO  USE  (1-10)?' 
TYPE  *, '  ' 

***  INPUT  THE  DESIRED  LOGICAL  UNIT  NUMBER  *** 


TYPE  2 

FORMAT(5X, 'LOGICAL  UNIT  NUMBER  -  ',$) 

ACCEPT  * , LUN1 

***  CHECK  FOR  INCORRECT  NUMBER  *** 

IF(LUN1.LT. 1.0R.LUN1.GT. 10)GO  TO  3 
IF (LUN1.EQ.  5)0,0  TO  4 
IF(LUN1.EQ.6)G0  TO  5 
IF(LUN1.EQ.LUNCW)G0  TO  6 
C 

RETURN 

3  TYPE  ' 

TYPE  *,'***  INVALID  LOGICAL  UNIT  NUMBER' ,LUN1 , '  ATTEMPTED  ***' 
TYPE  ' 

TYPE  *, 'LOGICAL  UNIT  NUM3ER  MUST  BE  RF.TWEEN  1  AND  10.' 

GO  TO  1 

4  TYPE  ' 

TYPE  *, 'LOGICAL  UNIT  5  IS  RESERVED  FOR  THE  USERS  TERMINAL.' 
TYPE  *, 'PLEASE  USE  ANOTHER  NUMBER!' 

GO  TO  l 

5  TYPE  ' 

TYPE  *, 'LOGICAL  UNIT  6  IS  RESERVED  FOR  THE  LINE  PRINTER.' 

TYPE  *, 'PLEASE  USE  ANOTHER  NUMBER!' 

GO  TO  1 

6  TYPE  ' 

TYPE  *,  'LOCICAL  UNIT  NUMBER'  .LIJNCW, '  ALREADY  IN  USE.' 

TYPE  *, 'PLEASE  USE  ANOTHER  NUMBER!' 

GO  TO  1 
END 
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SUBROUTINE  IPSOUT( IPSERR) 


C 

C  TllIS  SUBROUTINE  OUTPUTS  A  COMPLETE  SET  OF  INTERESTING  POINTS 

C  FOR  PERMENANT  STORAGE  AFTER  INTERESTING  POINT  PROCESSING  IS 

C  COMPLETE.  THE  FIRST  RECORD  CONTAINS  THE  NUMBER  OF  INTERESTING 

C  POINTS,  THE  TYPE,  AND  THE  CORRELATION  WINDOW  ROW,  COLUMN,  AND 

C  OVERALL  SIZE.  SUBSEQUENT  RECORDS  CONTAIN  THE  ROW  AND  COLUMN 

C  LOCATIONS  OF  THE  POINT  ON  THE  IMAGE,  THE  VALUE  OF  THE  POINT, 

C  AND  THE  CORRELATION  WINDOW  INTENSITY  VALUES. 

C 

INCLUDE  'COMMON. FTN' 

COMMON  /IOP/  IOPNBR 
COMMON  /IFILEI/  LUN1 
COMMON  /CWFILF,/  LUNCW 

COMMON  /IPS/  IPKNT, I?R(M),IPC(M),VALUIP(M),IPWND(M/3) 

COMMON  /CORWND/  CWDROW,CWDCOL,IX,IY,CWDSZE 
INTEGER  CWDROW ,CWDCOL,CWDSZE 

***  OPEN  THE  FILE  FOR  INTERESTING  POINT  STORAGE  *** 

CALL  OPNIF 1(IPS ERR) 

IF( IPSERR. EQ . 1 )RETURN 

***  WRITE  FIRST  RECORD  *** 

WRITE  (LUN1,1,ERR-100)  IPKNT, IOPNBR, CWDROW .CWDCOL.CWDSZE 
FORMAT( 513) 

REWIND  LUNCW 
DO  10  1-1 ,  IPKNT 

***  INPUT  EACH  INTERESTING  POINT  CORRELATION  WINDOW  *** 

READ(LUNCW,2,END-3,ERR-200)(IPWND(J),J«1,CWDSZE) 

FORMAT( <CWDSZE> 13 ) 

***  WRITE  SECOND  AND  SUCCESSIVE  RECORDS  *** 

WRITE(LUN1 , 4 , ERR-1 OO)IPR(I) , IPC(I ) , VALUIP(I ) , (IPWND(J) , J-l , CWDSZE) 
FORMAT(2I3,F10.3,<CWDSZE>I3) 

10  CONTINUE 

CLOSE (UNIT" LUNCW, DISPOSE- 'DELETE' ) 

CL0SE(UNIT"LUN1 , DISPOSE- 'KEEP ' .ERR-300) 

RETURN 

100  TYPE  *,'  ' 

TYPE  *,'***  WRITE  ERROR  OCCURED  IN  IPSOUT  OH  LOGICAL  IJNIT'.LUNl, 

1'  ***' 

CLOSE(UNIT-LUNCW, DISPOSE- 'DELETE' ) 

CL0SE(UNIT*LUN1 , DISPOSE- 'KEEP ' .ERR-300) 
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IPS ERR  -  1 

WRITE  (6,*)  '***  EXIT  IPSOUT  -  WRITE  ERROR  TERMINATION  ***' 

RETURN 

TYPE  ' 

TYPE  *,'***  READ  ERROR  OCCURED  IN  IPSOUT  ON  LOGICAL  UNIT' .LUNCW 
1'  ***' 

CLOSE(UNIT«LUNCW, DISPOSE- 'DELETE' ) 

CLOSE(UNIT-LUNl , DISPOSE-' KEEP ' .ERR-300) 

IPS ERR  -  1 

WRITE  (6,*)  '***  EXIT  IPSOUT  -  READ  ERROR  TERMINATION  ***' 

RETURN 

TYPE  ' 

TYPE  *,'***  CLOSE  ERROR  OCCURED  IN  IPSOUT  ON  LOGICAL  UNIT' ,LUN1 
1'  ***• 

IPS ERR  -  1 

WRITE  (6,*)  '***  EXIT  IPSOOT  -  CLOSE  ERROR  TERMINATION  ***' 

RETURN 

END 


o  n  n  ooono 


SUBROUTINE  0PNIF1 (OPNERR) 

C 

THIS  SUBROUTINE  OPENS  A  FILE  FOR  PERMENANTLY  STORING  THE  SF.TS  OF 
INTERESTING  POINTS  AFTER  THEIR  CREATION.  THE  FILE  IS  A  SEQUENT¬ 
IAL  FORMATTED  FILE.  IT  IS  ALSO  USED  FOR  OPENING  A  FILE  TO  INPUT 
THE  FIRST  SET  OF  INTERESTING  POINTS  FOR  MATCHING. 

INCLUDE  '  COMMON.  FTN' 

COMMON  /IFILE1/  LUN1 , IX, FNAME1 (34) 

LOGICAL* l  FNAME1 
INTEGER  OPNERR 

***  OPEN  THE  FILE  *** 

OPEN(UNIT*LUNl .NAME-FNAMEl , DISPOSE* 'KEEP ' ,RECORDSIZE*M+20, 

1  TYPE* 'UNKNOWN' ,ERR*100) 

C 

RETURN 

100  TYPE  ' 

TYPE  *,'***  OPEN  ERROR  OCCURED  IN  OPNIF1  ON  LOGICAL  UNIT'.LUNl, 
1'  ***' 

CL0SE(UNIT*LUN1 , DISPOSE* ' KEEP ' , ERR-2  00 ) 

OPNERR  -  1 

WRITE  (6,*)  '***  EXIT  OPNIF1  -  OPEN  ERROR  TERMINATION  ***' 

RETURN 

200  TYPE  *, '  ' 

TYPE  *,'***  CLOSE  ERROR  OCCURED  IN  0PNIF1  ON  LOGICAL  UNIT'.LUNl, 
1'  ***' 

OPNERR  -  1 

WRITE  (6,*)  '***  EXIT  0PNIF1  -  CLOSE  ERROR  TERMINATION  ***' 

RETURN 

END 
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SUBROUTINE  I0P1 (INT, IOPERR) 

C 

C  THIS  SUBROUTINE  COMPUTES  THE  INTERESTING  POINTS  OF 

C  THE  SELECTED  IMAGE  USING  THE  METHOD  OF  SIMPLE  VARIANCE. 

C  IF  THE  VARIANCE  COMPUTED  FOR  EACH  WINDOW  POSITION  OF 

C  THE  IMAGE  IS  ABOVE  THE  USER-SPECIFIED  THRESHOLD,  THAT 

C  POINT  IS  DEFINED  TO  BE  AN  INTERESTING  POINT. 

C 

D  WRITE  (6,*)  '***  ENTER  IOP1  ***' 

C 

C  ***  SET  THRESHOLD  VALUE  *** 

C 

CALL  THRHLD(THRESH) 

***  INITIALIZE  INTEREST  OPERATOR  PARAMETERS  *** 

CALL  INITAL(IMCEND, IPSEND) 

***  COMPUTE  THE  SIMPLE  VARIANCE  OF  EACH  WINDOW  POSITION  *** 

0  CALL  SVAR(INT,VARNCE, IOPERR) 

IF(IOPEP.R.EQ.  1  )GO  TO  20 

***  TEST  COMPUTED  VARIANCE  TO  SEE  IF  INTERESTING  POINT  EXISTS  *** 

IF(VARNCE.GT.THRESH)CALL  IPSTOR(VARNCE, IOPERR, IPSEND) 
IF(IOPERR.EO. 1 .OR. IPS END. EQ. l)GO  TO  20 

***  MOVE  WINDOW  ONE  IMAGE  ELOIENT  *** 

CALL  WNDMOV ( IMGE ND ) 

IF(IMGEND.NE. 1 )GO  TO  IQ 
C 

20  CALL  CLOSKP( IOPERR) 

RETURN 

END 
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SUBROUTINE  INITAL(  IMGEND,  IPS  END) 

THIS  SUBROUTINE  INITIALIZES  THE  WINDOW  POSITION  AND  VARIOUS 
OTHER  PARAMETERS  USED  IN  THE  INTEREST  OPERATOR  SELECTED. 

COMMON  /IPS/  IPKNT 
com::on  /count/  wndknt 

COMMON  /MOVE/  ROWKNT, COLKNT, ROWDIF, COLDIF 
COMMON  /WINDOW/  WNDROW , WNDCOL, WNDRWH , WNDCLH 
INTEGER  ROWKNT, COLKNT, ROWDIF .COLDIF 
INTEGER  WNDROW , WNDCOL , WNDRWH , WNDCLH, WNDKNT 

***  INITLALIZE  WINDOW  POSITION  *** 

ROWKNT  -  1 
COLKNT  -  1 
WNDKNT  -  1 
ROWDIF  -  WNDROW 
COLDIF  -  WNDCOL 
WNDRWH  -  WNDROW/ 2 
WNDCLH  -  WNDCOL/2 


IPKNT  -  0 
IMGEND  -  0 
IPSEND  -  0 
WRITE  (6,*)  '  ' 

WRITE  (6,*)  'ROWKNT  -  '.ROWKNT,'  ROWDIF  -  '.ROWDIF 

WRITE  (6,*)  'COLKNT  -  '.COLKNT,'  COLDIF  -  '.COLDIF 

WRITE  (6,*)  '  ' 

RETURN 

END 
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SUBROUTINE  THRHLD(THRESH) 


THIS  SUBROUTINE  ALLOWS  THE  USER  to  INPUT  A  THRESHOLD 
VALUE  USED  TO  TEST  FOR  INTERESTING  POINTS. 

TYPE  ' 

TYPE  *, 'WHAT  VALUE  OF  THRESHOLD  DO  YOU  WISH  TO  USE?' 

TYPE  ' 

TYPE  2 

FORMAT(5X,' INTERESTING  POINT  THRESHOLD  -  ',S) 

ACCEPT  *, THRESH 
TYPE  ' 

TYPE  *, 'HERE  IS  WHAT  YOU  HAVE  INPUT:' 

TYPE  ' 

***  DISPLAY  THE  VALUE  OF  THRESHOLD  *** 

TYPE  *, 'INTERESTING  POINT  THRESHOLD  -  '.THRESH 
C 

C  ***  VERIFY  THE  CORRECT  RESPONSE  *** 

C 

CALL  VERIFY( ANSWER) 

C 

IF(ANSWER.EO. 'NO' )GO  TO  I 
WRITE  (6,*)  '  ' 

WRITE  (6,*)  '***  THRESHOLD  FOR  INTERESTING  POINT  TESTS  ***' 
WRITE  (6,*)  '  ' 

WRITE  (6,*)  'INTERESTING  POINT  THRESHOLD  -  '.THRESH 
WRITE  (6,*)  '  ' 

RETURN 

END 
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SUBROUTINE  SVAR(  I  NT,  VARN'CE,  VARERR) 

C 

C  THIS  SUBROUTINE  CALCULATES  THE  SIMPLE  VARIANCE  OF  THE 

C  DISTRIBUTION  OF  IMAGE  ELEMENT  INTENSITIES  OVER  EACH 

C  WINDOW  POSITION  ON  THE  SELECTED  IMAGE. 

C 

COMMON  /MEAN/  X,SQRSUM,MF.AN 
COMMON  /WINDOW/  IA, IB, IC, ID, IE.WNDINV 
INTEGER  VARERR 
REAL  MEAN 

D  WRITE  (6,*)  '***  ENTER  SVAR  ***' 

***  CALCULATE  THE  MEAN  AND  SIM  OF  SQUARES  OF  THE  ELEMENTS  OVER 
EACH  WINDOW  POSITION  ON  THE  IMAGE  *** 

CALL  MEANFD(INT, VARERR) 

IF(VARERR.EO. I )RETURN 

***  COMPUTE  THE  VARIANCE  OVER  THE  WINDOW  *** 

SQRMN  -  MEAN*ffEAN 
VARNCE  -  WND INV  *5QRSUM  -  SQRMN 
C 

D  WRITE  (6,*)  'VARIANCE  -  '.VARNCE 

D  WRITE  (6,*)  '  ' 

RETURN 

END 
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SUBROUTINE  MEANFD(INT, MNERR) 


C 

C  THIS  SUBROUTINE  CALCULATES  THE  MEAN  OF  ALL  THE  INTENSITY 

C  ELEMENTS  OVER  EACH  WINDOW  POSITION  ON  THE  SELECTED  IMAGE. 

C  THE  SUM  OF  THE  SQUARES  OF  EACH  INTENSITY  ELEMENT  OVER  THE 

C  WINDOW  IS  ALSO  COMPUTED  FOR  USE  IN  CALCULATING  THE  VARIANCE 

C  IN  SUBROUTINE  SVAR.  THF.  MEAN  IS  CALCULATED  BY  FIRST  SUMMING 

C  ALL  THF.  ELEMENTS  IN  A  COLUMN  THE  WIDTH  OF  THE  WINDOW.  EACH 

C  COLUMN  IS  SUM.'lED  FROM  LEFT  TO  RIGHT  ACROSS  THE  LENGTH  OF  THE 

C  ENTIRE  DIAGE.  AFTER  THIS,  FOR  EACH  WINDOW  POSITION,  THE 

C  COLUMNS  FALLING  WITHIN  THE  WINDOW  ARE  SUMMED  TO  OBTAIN  THE 

C  SUM  OF  ALL  THE  INTENSITY  ELEMENTS  WITHIN  THE  WINDOW.  THIS 

C  IS  WHEN  THE  WINDOW  IS  AT  THE  LEFTMOST  POSITION  ON  THE  LMACE . 

C  THIS  SUM  IS  THEN  MULTIPLIED  BY  THE  INVERSE  OF  THE  WINDOW 

C  SIZE  TO  OBTAIN  THE  MEAN.  WHEN  THE  WINDOW  IS  MOVED  TO  THE 

C  RIGHT,  THE  COLUMN  TO  THE  LEFT  IS  SUBTRACTED  AND  THE  COLUMN 

C  TO  THE  RIGHT  IS  ADDED  TO  THE  PREVIOUS  ELEMENT  SUM  TO  FORM 

C  THE  NEW  SUM.  THIS  SUM  IS  AGAIN  MULTIPLIED  BY  THE  INVERSE 

C  OF  THE  WINDOW  SIZE  TO  OBTAIN  THE  MEAN.  THE  SUM  OF  THE  SOUARES 

C  OF  THE  WINDOW  ELEMENTS  IS  OBTAINED  IS  THE  SAME  MANNER  AS  THE 

C  SUM  OF  THE  ELEMENTS  AS  DESCRIBED  ABOVE.  HOWEVER,  EACH 

C  ELEMENT  IS  MULTIPLIED  BY  ITSELF  FIRST  BEFORE  IT  IS  SUMMED. 

C 

INCLUDE  ' COMMON. FTN' 

COMMON  /REG1 /  S(M),T(M) 

COMMON  /MEAN/  COLSUM, SQRSUM, MEAN 
COMMON  /MOVE/  ROWKNT.COLKKT, IA, COLD IF 
COMMON  /WINDOW/  IB , WNDCOL, IC , ID , IE , WNDINV 
INTEGER  CO LKNT , ROWKNT , COLDIF , WNDCOL 
REAL  MEAN 

D  WRITE  (6,*)  '***  ENTER  MEANFD  ***' 

IF (CO LKNT. EQ. L)GO  TO  10 

***  FORM  NEW  SUM  BY  SUBTRACTING  PREVIOUS  COLUMN  AND  ADDING  NEXT 
COLUMN  TO  THE  RIGHT  *** 

COLSUM  *  COLSUM  +  S(COLDIF)  -  S(COLKNT-l) 

SQRSUM  -  SQRSUM  +  T(COLDIF)  -  T(COLKNT-l) 

WRITE  (6,*)  '  ' 

WRITE  (6,*)  'COLSUM  «  '.COLSUM,'  SQRSUM  -  '.SQRSUM 
GO  TO  20 

0  IF(ROWKNT.GT. 1 )CALL  ROWCHG( I NT , MNERR ) 

IF(MNERR. EQ . 1 )RETURN 

***  SUM  THE  ELEMENTS  OF  EACH  COLUMN  OF  WINDOW  LENGTH  ACROSS 
THE  IMAGE  *** 

CALL  AJ)DCOL(INT) 

C 
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COLSUM  -  0 
SQRSUM  -  0 
C 

C  ***  FORM  INITIAL  SUM  BY  SUMMING  THE  COLI'MNS  OF  ADDED  INTENSITY 

C  ELEMENTS  WHEN  THE  WINDOW  IS  IN  ITS  LEFTMOST  POSITION  ON  THE 

C  SELECTED  IMAGE  *** 

C 

DO  15  I-l.WNDCOL 
COLSUM  -  COLSUM  +  S(I) 

SQRSUM  -  SQRSUM  +  T(I) 

15  CONTINUE 

WRITE  (6,*)  '  ' 

WRITE  (6,*)  'COLSUM  -  '.COLSUM,'  SQRSUM  -  '.SQRSUM 

***  COMPUTE  THE  MEAN  *** 

0  MEAN  -  UND I NV  *CO  LS  UM 

WRITE  (6,*)  '  ' 

WRITE  (6,*)  'MEAN  =  '.MEAN 
WRITE  (6,*)  '  ' 

RETURN 

END 
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SUBROUT  I  NE  ADDCOL(INT) 


C 

C  THIS  SUBROUTINE  SUMS  THE  ELEMENTS  OF  A  COLUMN  THE  t/IDTH  OF 

C  THE  WINDOW  FOR  EACH  COLUMN  OF  THE  IMAGE  AND  STORES  THESE  SUMS 

C  IN  ARRAY  S.  THE  SQUARES  OF  THE  ELEMENTS  ARE  ALSO  SUMMED  IN 

C  LIKE  MANNER  AND  STORED  IN  ARRAY  T. 

C 

I NCLIJDE  ' COMMON.  FTN ' 

VIRTUAL  INT(2*N,M) 

COMMON  / R EG 1 /  S(M),T(M) 

COMMON  /WINDOW/  WKDROW 
COMMON  /IMAGE/  X.IMGCOL 
INTEGER  WNDROW , X 

D  WRITE  (6,*)  '***  ENTER  ADDCOL  ***' 

DO  10  J=1 , IMGCOL 
S(J)  -  0 
T(J  )  =0 

***  FORM  SUMS  OF  ELEMENTS  AND  ELEMENT  SQUARES  FOR  EACH  COLUMN  *** 

DO  10  I-l, WNDROW 
FLTINT  -  FLOAT( INT( I ,  J)  ) 

S(J)  -  S(J)  +  FLTINT 
SORINT  -  FLTIMT*FLTINT 
T(J)  «*  T(J)  +  SQRINT 
10  CONTINUE 

RETURN 
END 
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SUBROUTINE  ROWCHC( INT, ROWERR) 

C 

SINCE  THE  IMAGE  BEING  PROCESSED  IS  GENERALLY  TOO  LARGE  TO 
BE  STORED  IN  COMPUTER  MEMORY  IN  ITS  ENTIRETY,  IT  IS  BUFFERED 
IN  IN  SEGMENTS  AS  IT  IS  BEING  PROCESSED.  AN  I/O  BUFFER  IS 
USED  FOR  THIS  PURPOSE.  THUS,  AS  THE  WINDOW  IS  MOVED  ACROSS 
THE  IMAGE  FROM  ROW-TO-ROW,  THE  ROW  PREVIOUSLY  PROCESSED  IS 
REPLACED  WITH  A  NEW  ROW  FROM  THE  I/O  BUFFER  IN  A  ROTATING 
FASHION.  THIS  SUBROUTINE  PERFORMS  THE  ROW  CHANGE  OPERATIOPF 
AND  CALLS  FOR  MORE  I/O  BUFFER  DATA  WHEN  THE  CURRENT  SUPPLY 
OF  BUFFER  DATA  HAS  ALL  BEEN  UTILIZED. 

INCLUDE  ' COMMON. FTN' 

VIRTUAL  INT(2*N,M) 

COMMON  /BUF/  IOBUFR(L.M) 

COMMON  /MOVE/  X,XX,ROWDIF 
COMMON  /COUNT/  WNDKNT, BUFKNT 
COMMON  /IMAGE/  IMGROW, IMGCOL 
COMMON  /WINDOW/  WNDROW 
LOGICAL* 1  IOBUFR 

INTEGER  ROWERR, WNDKNT, BUFKNT, ROWDIF .WNDROW , X, XX 
WRITE  (6,*)  '***  ENTER  ROWCHG  ***' 

WRITE  (6,*)  '  ' 

WRITE  (6,*)  'WNDKNT  =  ' , WNDKNT, '  BUFKNT  =  '.BUFKNT 
l /RITE  (6,*)  '  ' 

DO  10  J- I, IMGCOL 

***  PERFORM  ROW  CHANGE  *** 

INT(WNDKNT.J)  =  IOBUFR( BUFKNT, J) 

***  PERFORM  BYTE  TO  WORD  NUMBER  CONVERSION  *** 

IF ( INT( WNDKNT, J). LT. 0)INT( WNDKNT, J)  -  INT(WNDKNT, J)  +  25* 

0  CONTINUE 

if(wndknt.eo.wndrow)w:jdknt  -  o 

WNDKNT  *  WNDKNT  +  1 

IF(BUFKNT.EQ. L. AND. ROWDIF. LT. IMGR0W)G0  TO  20 

BUFKNT  -  BUFKNT  +  1 

RETURN 

***  REFILL  I/O  BUFFER  WITH  NEW  IMAGE  DATA  *** 

20  CALL  BUF RIN( ROWERR) 

C 

RETURN 

END 
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C 

G  THIS  SUBROUTINE  INPUTS  IMAGE  INTENSITY  DATA  INTO  THE  I/O 

C  BUFFER  L  ROWS  AT  A  TIME. 

C 

INCLUDE  'COMMON. FTN' 

COMMON  /BUF/  IOBUFR(L.M) 

COMMON  /INBUF /  I NTBUF(M) 

COMMON  /IMAGE/  IMGROW , IMGCOL 
COMMON  /COUNT/  X , BUFKNT, RECNUM 
LOGICAL* 1  IOBUFR 

INTEGER  BUFERR, EDFLAG .RECNUM , BUFKNT , X 
D  WRITE  (6,*)  '***  ENTER  BUFRIM  ***' 

BUFKNT  =  1 
EDFLAG  =  0 
NEW?.  EC  =  RECNUM 
LOOP  =  RECNUM  +  (L-l ) 

IF ( LOOP. CE. IMGROW) GO  TO  30 
5  I  -  0 

DO  20  RECNUM  =  MEWREC.LOOP 
1  =  1  +  1 
C 

C  ***  IN^UT  IMAGE  INTENSITY  DATA  INTO  I/O  BUFFER  *** 

C 

CALL  INPUT( RECNUM, I, BUFERR) 

IF ( BUFERR. EQ.  DRETURN 
C 

C  ***  PERFORM  BYTE  TO  WORD  NUMBER  CONVERSION  *** 

C 

D  DO  10  J=l, IMGCOL 

D  INTBUF(J)  -  IOBUFR(I.J) 

D  IF ( I NTBUF ( J ) . LT. 0 ) I NTEUF ( J )  =  INTBUF(J)  +  256 

DIO  CONTINUE 

C 

C  ***  WRITE  TO  LINE  PRINTER  *** 

C 

D  WRITE  (6,*)  'RECORD  NUMBER' .RECNUM, ' 

D  WRITE  (6,14) 

D14  FORMAT( 1 X,24( '-' )) 

D  WRITE  (6, 15)(INTBUF(J),J=1, IMGCOL) 

D15  FORMAT(26(2X, 13 ) ) 

D  WRITE  (6,*)  '  ' 

C 

20  CONTINUE 

IF ( EDFLAG . EO . 1 )G0  TO  40 
RETURN 

30  LOOP  -  IMGROW 

EDFLAG  -  1 
GO  TO  5 
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RECNUM  =»  1 

WRITE  (6,*)  '***  EXIT  BU FRIN  -  LAST  IMACE  ROW  INPUT  ***' 
WRITE  (6,*)  '  ' 

RETURN 

END 
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SUS  ROUT  I  'IF.  WNDMOV  ( IMGE  ND ) 

THIS  SUBROUTINE  MOVES  A  WINDOW  OF  DIMENSION  (WNDROW  X  WNDCOL) 
ACROSS  THE  SELECTED  IMAGE  ONE  ELEMENT  AT  A  TIME.  WHEN  THE 
EDGE  OF  THE  LMAGE  IS  REACHED,  THE  WINDOW  IS  MOVED  DOWN  ONE 
ROW  AND  REPOSITIONED  AT  THE  LEFT  IMAGE  BOUNDARY.  WINDOW 
MOVEMENT  IS  FROM  LEFT  TO  RIGHT  AND  FROM  TOP  TO  BOTTOM  ACROSS 
THE  IMAGE.  THE  WINDOW  REFERENCE  POSITION  IS  THE  UPPER  LEFT 
CORNER  OF  THE  WINDOW,  AND  IS  SPECIFIED  RELATIVE  TO  THE  IMAGE 
BY  THE  VARIABLES  ROWKNT  AND  COLKNT.  THE  BOTTOM  AND  RIGHT 
BOUNDARIES  OF  THE  WINDOW  ARE  SPECIFIED  BY  THE  VARIABLES 
ROW DIF  AND  COLDIF  RESPECTIVELY. 


COMMON  /IMAGE/  IMGROW , IMGCOL 

COMMON  /WINDOW/  WNDROW , WNDCOL 

COMMON  /MOVE/  ROWKNT, COLKNT, ROWDIF, COLD IF 

INTEGER  WNDROW , WNDCO L , ROWKNT , COLKNT, ROWDIF , COLD IF 

WRITE  (6,*)  '***  ENTER  WNDMOV  ***' 

WRITE  (6,*)  '  ' 


***  TEST  FOR  LMAGE  BOUNDARY  *** 

IF (COLDIF .EQ.  D!GCOL)GO  TO  50 
IF(COLDIF.GT.IMCCOL)GO  TO  100 

COLDIF  -  COLKNT  +  WNDCOL 
COLKNT  *  COLKNT  +  1 

WRITE  (6,*)  'ROWKNT  =  '.ROWKNT,'  ROWDIF  *  '.ROWDIF 

WRITE  (6,*)  'COLKNT  -  '.COLKNT,'  COLDIF  -  '.COLDIF 

WRITE  (6,*)  '  ' 

RETURN 

***  TEST  FOR  END  OF  IMAGE  *** 

IF(ROWDIF.EQ. IMGROW. AND. COLDIF. EO.IMCCOL)GO  TO  200 
IF ( ROWDIF. GT. IMGROW )G0  TO  150 


ROWDIF  =  ROWKNT  +  WNDROW 


ROWKNT  -  ROWKNT  +  1 
COLDIF  -  WNDCOL 
COLKNT  -  1 

WRITE  (6,*)  'ROWKNT  -  '.ROWKNT,' 
WRITE  (6,*)  'COLKNT  -  '.COLKNT,' 
WRITE  (6,*)  '  ' 

RETURN 
TYPE  *,'  ' 

TYPE  *,'***  IMAGE  COLUMN  BOUNDARY', 
TYPE  COLUMN  BOUNDARY ' .COLDIF 

GO  TO  50 


ROWDIF  -  '.ROWDIF 
COLDIF  -  '.COLDIF 


IMGCOL,'  EXCEEDED  BY  WINDOW 
,'  IN  WNDMOV  ***' 
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TYPE  ' 

TYPE  *,'***  IMAGE  ROW  BOUNDARY DIGROW , '  EXCEEDED  BY  WINDOW' 
TYPE  ROW  BOUNDARY' .ROWDIF,'  IN  WNDMOV  ***' 

200  IMGF.ND  -  1 

D  t/RITE  (6,*)  '***  EXIT  WNDMOV  -  END  OF  IMAGE  REACHED  ***' 

RETURN 
END 
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SUBROUTINE  I0P2 (INT, IOPERR) 


C 

C  THIS  SUBROUTINE  COMPUTES  THE  INTERESTING  POINTS  OF 

C  THE  SELECTED  IMAGE  USING  THE  METHOD  OF  DIRECTED 

C  VARIANCE  (THE  MORAVEC  OPERATOR).  THE  DIRECTED  VARIANCE 

C  VALUES  ARE  STORED  IN  A  TWO  DIMENSIONAL  ARRAY  D(2,*). 

C  THIS  ARRAY  IS  SEARCHED  FOR  THE  LOCAL  MAXIMA  OF  THE 

C  DIRECTED  VARIANCE  VALUES.  EACH  OF  THESE  MAXIMA  WHICH 

C  ARE  GREATER  THAN  A  USER-SPECIFIED  THRESHOLD  VALUE 

C  ARE  DEFINED  TO  BE  INTERESTING  POINTS. 

C 

INCLUDE  'COMMON. FTN' 

COMMON  /DSTOR/  DCOL, EPSLON, D(2 ,M) 

COMMON  /MOVE/  ROWKNT.COLKNT 
COMMON  /EDVAR/  EFLAG 
COMMON  /IMAGE/  X.IMCCOL 
COMMON  /WINDOW/  XX, WNDCOL 

INTEGER  DCOL, EFLAG , ROWKNT.COLKNT, WNDCOL, X, XX 
WRITE  (6,*)  '***  ENTER  IOP2  ***' 

***  SET  THRESHOLD  VALUE  *** 

CALL  THRHLD(THRESH) 

***  DETERMINE  THE  VALUE  OF  EPSILON  FOR  THE  TESTS  *** 

CALL  EPS  FNO(EPSLON) 

***  COMPUTE  THE  DIRECTED  VARIANCE  FOR  EACH  WINDOW  POSITION  *** 
***  INITIALIZE  INTEREST  OPERATOR  PARAMETERS  *** 

EFLAG  -  0 

CALL  INITAL(IMCEND,  IPSF-ND) 

DCOL  -  IMGCOL  -  WNDCOL  +  1 

0  CALL  DVAR( INT, IOPERR) 

IF( IOPERR. EQ.l)GO  TO  50 
IF(COLKNT.LT.DCOL)CO  TO  30 

***  FIND  THE  LOCAL  MAXIMA  OF  THE  DIRECTED  VARIANCES  *** 

CALL  MAXDVP. 

IF(ROWKNT.EQ. I )G0  TO  30 

***  TEST  VARIANCE  MAXIMA  TO  SEE  IF  INTERESTING  POINT  EXISTS  *** 
DO  20  1-1, DCOL 
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IF(D(  1 , 1)  .  LE.THRESH)GO  TO  20 

COLKNT  -  I 

ROWKNT  -  ROWKNT  -  1 

CALL  IPSTOR(D(  1,1),  IOPERR,  IPSF.ND) 

IF(IOPERR. EQ • 1 .OR. IPSEND.EQ . 1 )G0  TO  50 
ROWKNT  -  ROWKNT  +  1 
COLKNT  -  DCOL 
CONTINUE 

***  REPLACE  FIRST  ROW  OF  ARRAY  D  WITH  SECOND  ROW  ***' 
CALL  ORWCHG 

***  MOVE  WINDOW  ONE  IMAGE  ELEMENT  *** 

CALL  WNDMOV ( IMGE ND) 

IFCIMGEND.NE. 1 )G0  TO  10 

***  TEST  LAST  VARIANCE  ROW  FOR  INTERESTING  POINTS  *** 
DO  40  1=1, DCOL 

IF(D(2,I).LE.THRESH)G0  TO  40 
COLKNT  =  I 

CALL  IPSTQR(D(2 ,1) , IOPERR, IPSEND) 

IF( IOPERR. EQ . 1 .OR. IPSEND.EQ. 1 )G0  TO  50 
CONTINUE 

CALL  CL OSKPC IOPERR) 

RETURN 

END 
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SUBROUTINE  DVAR(  INT ,  VARERR ) 

C 

C  THIS  SUBROUTINE  CALCULATES  THE  DIRECTED  VARIANCE  OF  ALL 

C  THE  INTENSITY  ELEMENTS  OVER  EACH  WINDOW  POSITION  ON  THE 

C  SELECTED  IMAGE.  FOUR  VALUES  OF  VARIANCE  ARE  CALCULATED 

C  FOR  EACH  WINDOW  POSITION.  THESE  FOUR  VALUES  ARE  CALCULATED 

C  BY  ADDING  THE  SQUARES  OF  THE  DIFFERENCES  OF  ADJACENT 

C  ELEMENTS  IN  FOUR  DIFFERENT  DIRECTIONS  ACROSS  THE  WINDOW: 

C  (1)  ADJACENT  ON  THE  SAME  ROW  (XSUM) 

C  (2)  ADJACENT  ON  THE  SAME  COLUMN  (YSUM) 

C  (3)  ADJACENT  ON  THE  UPPER-TO-LOWER  DIAGONAL  (ASUM) 

C  (4)  ADJACENT  ON  THE  LOWER-TO-UPPER  DIAGONAL  (BSUM) 

C  THESE  SUMS  ARE  EACH  MULTIPLIED  BY  THE  INVERSE  OF  THE  WINDOW 

C  SIZE  TO  OBTAIN  THE  DIRECTED  VARIANCE  IN  EACH  DIRECTION.  THE 

C  OVERALL  DIRECTED  VARIANCE  IS  DEFINED  TO  BE  THE  MINIMUM  OF 

C  THESE  FOUR  QUANTITIES.  THE  MINIMUM  OF  PERPENDICULAR 

C  RATIOS  OF  THESE  FOUR  VARIANCES  IS  ALSO  COMPUTED  WHEN 

THE  EDGED  VARIANCE  IS  CALCULATED  (EFLAG-1). 

INCLUDE  ' COMMON. FTN' 

COMMON  /EDVAR/  EFLAG, RTOMIN 
COMMON  /REG2/  X(M) ,Y(M) ,A(M) , B(M) 

COMMON  /DRVAR/  XSUM , YSUM , ASUM , BSUM 
COMMON  /MOVE/  ROWKNT, COLKNT, IX, COLD IF 
COMMON  /WINDOW/  IA,WNDCOL,IB,IC,ID,WNDINV 
INTEGER  EFLAG .ROWKNT, COLKNT, COLDIF , WNDCOL, VARERR 
WRITE  (6,*)  '***  ENTER  DVAR  ***' 

IF ( COLKNT. EQ . 1 )GO  TO  10 

***  FORM  NEW  SUM  BY  SUBTRACTING  PREVIOUS  COLUMN  AND  ADDING  NEXT 
COLUMN  TO  THE  RICHT  *** 

XSUM  -  XSUM  +  X(COLDIF)  -  X(COLKNT-l ) 

YSUM  -  YSUM  +  Y(COLDIF)  -  Y(COLKNT-l) 

ASUM  -  ASUM  +  A( COLDIF)  -  A(COLKNT-l) 

BSUM  -  BSUM  +  B( COLDIF)  -  B(COLKNT-l) 

WRITE  (6,*)  '  ' 

WRITE  (6,9)  XSUM, YSUM, ASUM, BSUM 

9  F0PMAT(1X, 'XSUM  -  ' , FI  1 . 3, 2 X, ' YSUM  -  ' , FI  1 . 3 ,2X, ' ASUM  -  '.F11.3.2X 

1,'BSUM  -  ' ,F11.3,/) 

GO  TO  20 

0  IF (  EFLAG .  F.Q .  1  )GO  TO  12 

IF ( ROWKNT. GT. 1 )CALL  ROWCHG(INT, VARERR) 

IF( VARERR . EQ . 1 )RETURN 

***  SUM  THE  ELEMENTS  OF  EACH  COLUMN  OF  WINDOW  LENGTH  ACROSS 
THE  IMAGE  *** 
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12  CALL  ADDDIF(INT) 

C 

XSUM  -  0 
YSUM  »  0 
ASUM  -  0 
BSUM  -  0 
C 

C  ***  FORM  INITIAL  SUM  BY  SUMMING  THE  COLUMNS  OF  ADDED  INTENSITY 

C  ELEMENTS  WHEN  THE  WINDOW  IS  IN  ITS  LEFTMOST  POSITION  ON 

C  THE  IMAGE  *** 

C 

DO  15  I-l.WNDCOL 
XSUM  -  XSUM  +  X(I) 

YSUM  -  YSUM  +  Y(I) 

ASUM  -  ASUM  +  A(I) 

BSUM  -  BSUM  +3(1) 

15  CONTINUE 

D  WRITE  (6,*)  '  ' 

D  WRITE  (6,9)  XSUM, YSUM, ASUM, BSUM 

C 

C  ***  COMPUTE  THE  FOUR  DIRECTED  VARIANCES  *** 

C 

20  DVAR1  -  WNDINV*XSUM 

DVAR2  «  WNDINV*YSUM 
DVAR3  -  WNDINV*ASUM 
DVAR4  -  WNDINV*BSUM 
C 

D  WRITE  (6,21)  DVAR1 , DVAR2 , DVAR3 , DVAR4 

D21  FORMAT( 1 X, 'DVAR1  -  ' , FIO. 3,2X, 'DVAR2  -  ' ,F10. 3,2X, 'DVAR3  -  ' 

D  1,F10.3,2X,' DVAR4  -  '.F10.3,/) 

IF ( EFLAG . EQ . 1 )GO  TO  30 

***  COMPUTE  THE  OVERALL  DIRECTED  VARIANCE  *** 

DIRVAR  -  MIN(DVAR1,DVAR2,DVAR3,DVAR4) 

WRITE  (6,*)  'DIRVAR  -  '.DIRVAR 
WRITE  (6,*)  '  ' 

***  STORE  THE  OVERALL  DIRECTED  VARIANCE  *** 

CALL  DVSTOR( DIRVAR) 

RETURN 

***  CALCULATE  PERPENDICULAR  RATIOS  OF  THE  VARIANCES  *** 

0  CALL  P.ATIO(DVARl ,  DVAR2 ,  DVAR3.DVAR4 .RATIO 1  ,RATI02  ,RATI03  ,RATI04) 

***  CALCULATE  THE  MINIMUM  OF  THESE  RATIOS  *** 
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RTOMI!!  -  MIN( RATIO 1 ,RATI02 , RATI03 ,RATI04) 
C 

5 TRITE  (6,*)  ' RTOMI N  =  ' , RTOMI N 
WRITE  (6,*)  '  ' 

RETURN 
END 


272 


n  n  n  ooooaoo  nj  non 


SUBROUTINE  MAXDVR 


C 

C  THIS  SUBROUTINE  DETERMINES  THE  LOCAL  MAXIMA  OF  THE 

C  DIRECTED  VARIANCE  VALUES  COMPUTED  IN  SUBROUTINE  DVAR. 

C  THESE  VARIANCE  VALUES  ARE  STORED  IN  ARRAY  D(2,*)  TWO 

C  RONS  AT  A  TIME.  AFTER  THE  FIRST  ROW  HAS  BEEN  STORED, 

C  IT  IS  COMPARED  BY  ADJACENT  ELEMENTS  ACROSS  THE  ROW. 

C  AFTER  THE  SECOND  ROW  HAS  BEEN  STORED,  THE  SEARCH 

C  PROCESS  IS  EXPANDED  TO  INCLUDE  ELEMENT  NEIGHBORS  ON 

C  BOTH  ROWS.  AS  THE  ELEMENTS  ARE  CHECKED,  THOSE  THAT 

C  ARE  SMALLER  THAN  ALL  THEIR  NEIGHBORS  ARE  SET  NEGATIVE. 

C  ELEMENTS  REMAINING  POSITIVE  AFTER  THE  SEARCH  HAS 

C  BEEN  COMPLETED  ARE  THE  LOCAL  MAXIMA. 

C 

INCLUDE  'COMMON. FTN' 

COMMON  /MOVE/  ROWKNT 

COMMON  /DSTOR/  DCOL, EPS  LON, D( 2, M) 

INTEGER  DCOL, ROWKNT 

D  WRITE  (6,*)  '***  ENTER  MAXDVR  ***' 

K  *  MOD(ROWKNT,2) 

IF ( ROWKNT. GT. I )GO  TO  10 

***  PERFORM  INITIAL  ROW  CHECKS  *** 

DO  2  1*1 , DCOL-1 

1F( (ABS(D( 1 , I) )-D( 1 , 1+1 )) .OF. EPSLON)GO  TO  1 
IF(D( 1 , I) .LT.O. 0)CO  TO  2 
0(1,1)  -  -D(1,I) 

CO  TO  2 

IF(D( 1 , 1+1 ).LT.O.O)GO  TO  2 
D( 1,1+1)  -  -D( 1,1+1) 

CONTINUE 
WRITE  (6,*)  '  ' 

WRITE  (6,*)  'FIRST  D  ROW:' 

WRITE  (6, A) 

A  FORMAT( IX, 1 A( '-' )) 

V7RITE  (8,3)(D(1,I),I*1,  DCOL) 

3  FORMAT( 10(2X,F11.3)) 

WRITS  (6,*)  '  ' 

RETURN 

***  TEST  THE  LEFT  END  THREE  ELEMENTS  OF  D  ARRAV  *** 

10  I  -  1 
IF(K.EQ.O)GO  TO  11 

IF( (ABS(D( 1,1) )-D( 2,1) ) .GE. EPSLON)CO  TO  30 
GO  TO  15 

11  IF((ABS(DM,1))-D(2,1)).0T.EPSL0H)00  TO  30 

15  IF(D(1,1).LT.0.0)G0  TO  20 
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D(  1 , 1 )  =  -0(1,1) 

GO  TO  40 

I?(K.EO.O)GO  TO  21 

IF((ABS(D(1,2))-ABS(D(2, 1))).GE.EPSL0N)00  TO  30 
GO  TO  25 

21  IF( (ABS(D( 1,2) )-ABS(D( 2, 1 ) ) ) . GT. EPSLON)GO  TO  30 

25  IF(D(  1 , 2).LT.O.O)GO  TO  40 

D(l,2)  *  -D(l,2) 

GO  TO  40 

30  IF(D(2,1).LT. 0.0)00  TO  40 

D(2 , 1 )  =  -D(2 , 1 ) 

IF(D(l,l).GT.O.O)GO  TO  40 
GO  TO  20 
C 

C  ***  TEST  MIDDLE  ELEMENTS  OF  D  ARRAY  FIVE  AT  A  TIME  *** 

C 

40  FOUNT  =  0 
1  =  1+1 

IF ( I . EO , DCOL)GO  TO  100 
IF(F.E0.0)G0  TO  41 

IF((A3S(D(l,I))-D(2,I)).GE.EPSLON)GO  TO  80 
FOUNT  =  FOUNT  +  1 
GO  TO  45 

41  IF((ABS(D(1,I))-D(2,I)).GT.EPSL0N)G0  TO  80 

FOUNT  =  FOUNT  +  1 

45  IF(D( 1 , I) . LT. 0.0 )G0  TO  50 

D(  1 , 1)  =  ~D( 1,1) 

GO  TO  40 

50  IF(F.EO.O)GO  TO  51 

IF( (ABS(D(2 , 1-1 ) )-ABS(D(2 , I) ) ) . GE.EPSLON)GO  TO  80 
FOUNT  =  FOUNT  +  1 
GO  TO  55 

51  IF((ABS(D(2,I-l))-ABS(D(2,I))).OT.EPSLON)CO  TO  80 

FOUNT  =  FOUNT  +  1 

55  IF(D(2 , 1-1 ) . LT.O .0 )G0  TO  60 

D(2,I-1)  =  ~D(2, 1-1 ) 

GO  TO  70 

60  IF(K.EQ.O)GO  TO  61 

IF( (ABS(D( 1,1-1) )-ABS(D( 2,1))) ,GE.EPSLON)GO  TO  80 
FOUNT  ■  FOUNT  +  1 
GO  TO  65 

61  IF( (ABS(D( 1,1-1) )-ABS(D( 2 , I) ) ) .GT. EPSLON)GO  TO  80 
FOUNT  =  FOUNT  +  1 

65  IF(D( 1 , 1-1 ).LT.O.O)GO  TO  70 

D(1,I-1)  -  -D( 1,1-1) 

70  IF(F.EQ.O)GO  TO  71 

IF((ABS(D( 1,I+1))-ABS(D(2,I))).GE.EPSL0N)G0  TO  80 
GO  TO  75 

71  IF((ABS(D( 1,1+1 ))-ABS(D(2,I))).OT.EPSLON)GO  TO  80 

75  IF(D( 1 , 1+1 ).LT. 0.0)G0  TO  40 
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D( 1,1+1)  -  -D( 1,1+1) 

GO  TO  40 

80  KOUNT  =  KOUNT  +  1 

IF ( D ( 2 , I ) . LT . 0 . 0 )G0  TO  90 
D(2,I)  =  -D(2,I) 

90  IF(D(1 , I).GT.O.O)GO  TO  40 

GO  T0( 50 , 60, 70 , 40)K0UNT 
C 

C  ***  TEST  THE  RIGHT  END  FOUR  ELEMENTS  OF  D  ARRAY  *** 

C 

100  IF(K.EQ. 0)0.0  TO  101 
IF((A3S(D<l,I))-D(2,I)).GE.EPSLON)GO  TO  130 
KOUNT  =  KOUNT  +  1 

GO  TO  105 

101  IF((ABS(D(1,I))-D(2,I)).GT.EPSL0N)C0  TO  130 

KOUNT  =  KOUNT  +  1 

105  IF(D(l,I).LT.O.O)GO  TO  110 

D(  1 , 1)  =  -D( 1,1) 

GO  TO  150 

110  IF(K.EQ.O)CO  TO  111 
IF((ABS(D(2,I-l))-ABS(D(2,I))).GE.EPSLON)GO  TO  130 
KOUNT  =  KOUNT  +  1 

GO  TO  115 

111  IF((ABS(D(2,t-l))-ABS(D(2,I))).GT.EPSLON)CO  TO  130 
KOUNT  -  KOUNT  +  1 

115  IF(D(2 , 1-1 ). LT. 0. 0)GO  TO  120 

D(2,I-l)  *  -D(2,I-1) 

GO  TO  150 

120  IF(K.EO.0)G0  TO  121 
IF((ABS(D(l,I-l))-ABS(D(2,I))).GE.EPSL0M)0O  TO  130 
GO  TO  125 

121  IF((ABS(D(1,I-1 ))-ABS(D(2,I))).GT.EPSL0N)G0  TO  130 

125  IF(D( 1 , 1-1 ). LT. 0. 0)GO  TO  150 

D( 1,1-1)  -  -D( 1,1-1) 

GO  TO  150 

130  KOUNT  -  KOUNT  +  1 

IF(D(2,I).LT.0.0)C0  TO  140 
0(2,1)  -  -D(2,I) 

140  IF(D(1,I).GT.O.O.OR.D(2,I-1).GT.O.O)GO  TO  150 

GO  T0( 1 10, 120, 150)K0UNT 
1 50  CONTINUE 

D  WRITE  (6,*)  '  ' 

D  WRITE  (6,*)  'D  ROTS' ,R0WKNT-1 , '  AND' .ROWKNT, '  :' 

D  WRITE  (6,5) 

D5  FORMAT( 1X,28('-')) 

D  WRITE  (6,3)(D(l,I),I-l,DCOL) 

D  WRITE  (6,*)  '  ' 

D  WRITE  (6,3)(D(2,I),I-1,DC0L) 

D  WRITE  (6,*)  '  ' 

RETURN 
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SUBROUTINE  DRWCHG 


THIS  SUBROUTINE  REPUCES  THE  FIRST  ROW  OF  ARRAY  D  WITH 
THE  SECOND  ROW. 

INCLUDE  ' COMMON. FTN' 

COMMON  /DSTOR/  DCOL, X, D(2 , M) 

INTEGER  DCOL 

WRITE  (6,*)  '***  ENTER  DRWCHG  ***' 

***  PERFORM  THE  ROW  CHANGE  OPERATION  *** 

DO  10  1=1 , DCOL 
D(1,I)  =  D(2,I) 

CONTINUE 

RETURN 

END 
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SUBROUTINE  DVS TOR (DVAR) 


THIS  SUBROUTINE  STORES  THE  VALUES  OF  THE  DIRECTED 
VARIANCES  AS  THEY  ARE  CALCULATED  IN  SUBROUTINE  DVAR. 

INCLUDE  'COMMON. FTN' 

COMMON  /DSTOR/  X,XX,D(2,M) 

COMMON  /MOVE/  ROWKNT , COLKNT 
INTEGER  ROWKNT, COLKNT, X 
WRITE  (6,*)  '***  ENTER  DVSTOR  ***' 

IF(ROWKNT.EQ.l)GO  TO  10 

***  STORE  VALUES  AFTER  FIRST  IMAGE  ROW  *** 

D( 2, COLKNT)  »  DVAR 
RETURN 

***  STORE  VALUES  FOR  FIRST  IMAGE  ROW  *** 

10  0(1, COLKNT)  -  DVAR 

C 

RETURN 

END 


278 


n  o  n  ►-  n  n  n  n  n  n  n  non  o  ononnn 


SUBROUTINE  ADDDIF(INT) 


THIS  SUBROUTINE  SUMS  THE  SOUARES  OF  THE  DIFFERENCES  OF 
ADJACENT  ELEMENTS  IN  FOUR  DIRECTIONS  FOR  A  COLUMN  THE 
WIDTH  OF  THE  WINDOW  FOR  EACH  COLUMN  OF  THE  IMAGE.  THESE 
SUMS  ARE  STORED  IN  ARRAYS  X(*)»  Y(*),  A(*),  AND  B(*). 

INCLUDE  'COMMON. FTN' 

VIRTUAL  INT(2*N,M) 

COMMON  /REG2/  X(M) , Y(M) ,A(M) , B(M) 

COMMON  /WINDOW/  WNDROW 

COMMON  /IMAGE/  XX, IMGCOL 

INTEGER  WNDROW, XX 

WRITE  (6,*)  '***  ENTER  ADDDIF  ***' 

DO  10  J-1.IMCC0L-1 

X(J)  -  0 

Y(J)  -  0 

A(J)  -  0 

B(J)  -  0 

DO  10  1-1  , WNDROW- 1 

***  COMPUTE  ADJACENT  ELEMENT  DIFFERENCES  IN  FOUR  DIRECTIONS  *** 

DIFROW  -  INT(I , J)  -  INT(I,J+1) 

DIF COL  -  INT(I , J)  -  INT(I+1,J) 

DIFULD  -  INT(I,J)  -  INra+t,J+l) 

DIFLUD  -  INT<I+1,J)  -  INT(I,J+1) 

***  COMPUTE  SQUARES  OF  FOUR  ADJACENT  DIFFERENCES  *** 

DFSQRW  -  DIFROW*Dr  ROW 
DFSQCL  -  D IF COL*D IF COL 
DFSQUL  -  DIFULD*DIFULD 
DFSQLU  -  DIFLUD*D IFLUD 

***  FORM  SUMS  OF  DIFFERENCE  SQUARES  FOR  EACH  COLUMN  *** 

X(J)  -  X(J)  +  DFSQRW 
Y(J)  -  Y(J)  +  DFSQCL 
A(J)  -  A(J)  +  DFSOUL 
B( J)  -  B( J)  +  DFSQLU 

0  CONTINUE 

***  DETERMINE  VALUES  OF  END  SUMS  *** 

Y( IMGCOL)  -  0 
DO  20  1*1 , WNDROW- 1 

DFCLED  -  INT(I, IMGCOL)  -  INT(I+1 .IMGCOL) 
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DFSQCE  -  DFCLED*DFCLEI> 
Y(IMGCOL)  -  Y(IMGCOL)  +  DFSQCE 
CONTINUE 

X(IMGCOL)  -  X(IMGCOL-I) 
A(IMGCOL)  -  A( IMCCOL-1 ) 
B(IMGCOL)  -  B(IMGCOL-l) 


RETURN 
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SUBROUTINE  EPSFND(EPSLON) 

THIS  SUBROUTINE  ALLOWS  THE  USER  TO  INPUT  AN  EPSILON 
VALUE  USED  TO  TEST  FOR  INTERESTING  POINTS. 

TYPE  ' 

TYPE  *, 'WHAT  VALUE  OF  EPSILON  DO  YOU  WISH  TO  USE?' 

TYPE  ' 

TYPE  2 

FORMAT(5X, 'EPSILON  -  ',$) 

ACCEPT  *, EPSLON 
TYPE  ' 

TYPE  *, 'HERE  IS  WHAT  YOU  HAVE  INPUT:' 

TYPE  ' 

***  DISPLAY  THE  VALUE  OF  EPSILON  *** 

TYPE  *, 'EPSILON  -  ' , EPSLON 

***  VERIFY  THE  CORRECT  RESPONSE  *** 

CALL  VERIFY (ANSWER) 

C 

IF ( ANSWER. EQ. 'NO' )GO  TO  1 
WRITE  (6,*)  '  ' 

WRITE  (6,*)  ’***  EPSILON  VALUE  FOR  DIRECTED  VARIANCE  TESTS  ***' 
WRITE  (6  *)  '  ‘ 

WRITE  (6*,*)  'EPSILON  -  '.EPSLON 
WRITE  (6,*)  '  ' 

RETURN 

END 
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SUBROUTINE  IOP3(INT, IOPERR) 

THIS  SUBROUTINE  COMPUTES  THE  INTERESTING  POINTS  OF 
THE  SELECTED  IMAGE  USING  THE  METHOD  OF  EDGED  VARIANCE. 

THE  DIRECTED  VARIANCE  IN  FOUR  DIRECTIONS  IS  FIRST 
COMPUTED  USING  SUBROUTINE  DVAR.  THE  MINIMUM  OF  FOUR 
PERPENDICULAR  RATIOS  IS  THEN  FOUND.  NEXT,  THE  SIMPLE 
VARIANCE  IS  COMPUTED  USING  SUBROUTINE  SVAR.  THE  EDGED 
VARIANCE  IS  FORMED  BY  THE  PRODUCT  OF  THE  SLMPLE 
VARIANCE  AND  THE  MINIMUM  OF  THE  FOUR  PERPENDICULAR 
RATIOS.  EACH  COMPUTED  VALUE  OF  EDGED  VARIANCE  IS 
TESTED  AGAINST  A  USER-DEFINED  THRESHOLD.  IF  THE  VALUE 
OF  THE  EDGED  VARIANCE  IS  GREATER  THAN  THE  THRESHOLD 
VALUE,  THAT  POINT  IS  DEFINED  TO  BE  AN  INTERESTING  POINT. 

WRITE  (6,*)  '***  ENTER  IOP3  ***' 

***  SET  THRESHOLD  VALUE  *** 

CALI.  THRHLD(THRESH) 

***  INITIALIZE  INTEREST  OPERATOR  PARAMETERS  *** 

CALL  INITAL(IMGEND, IPS END) 

***  COMPUTE  THE  EDGED  VARIANCE  FOR  EACH  WINDOW  POSITION  *** 

CALL  EVAR( INT , EDGVAR, IOPERR) 

IF(IOPERR.EQ.l)GO  TO  20 

***  TEST  COMPUTED  VARIANCE  TO  SEE  IF  INTERESTING  POINT  EXISTS  *** 

IF( EDGVAR. GT.THRESH)CALL  IPSTOR( EDGVAR, IOPERR, IPSEND) 
IF(IOPERR.EO. I .OR. IPSEND.EQ. 1 )GO  TO  20 

***  MOVE  WINDOW  ONE  IMAGE  ELEMENT  *** 

CALL  WNDMOV ( IMGE  ND ) 

IF(IMGEHD.NE.l)GO  TO  10 

CALL  CLOSKP( IOPERR) 

RETURN 

END 
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SUBROUTINE  EVAR( I NT, E DC VAR, VARERR) 

THIS  SUBROUTINE  COMPUTES  THE  VALUE  OF  EDGED  VARIANCE  FROM 
THE  SIMPLE  VARIANCE  CALCULATED  IN  SUBROUTINE  SVAR,  AND  THE 
FOUR  VALUES  OF  DIRECTED  VARIANCE  CALCULATED  IN  SUBROUTINE 
DVAR, 

COMMON  /EDVAR/  EFLAG.RTOMIN 

INTEGER  VARERR, EFLAG 

WRITE  (6,*)  '***  ENTER  EVAR  ***' 

EFLAG  -  1 

***  COMPUTE  THE  SIMPLE  VARIANCE  *** 

CALL  SVAR(INT,VARNCE, VARERR) 

IF(VARERR.EQ . 1 ) RETURN 

***  COMPUTE  THE  MINIMUM  OF  THE  FOUR  PERPENDICULAR  RATIOS 
OF  DIRECTED  VARIANCE  *** 

CALL  DVAR(INT, VARERR) 

***  COMPUTE  THE  EDGED  VARIANCE  *** 

EDGVAR  -  VARNCE*RTOMIN 

WRITE  (6,*)  'EDGVAR  «  '.EDGVAR 
WRITE  (6,*)  '  ' 

RETURN 


SUBROUTINE  RATIO (DVAR1 , DVAR2 , DVAR3, DVAR4, RATIOl .RATI02 .RATI03, 
1RATI04) 


C 

C  THIS  SUBROUTINE  COMPUTES  POUR  PERPENDICULAR  RATIOS  OF  THE  FOUR 

C  DIRECTED  VARIANCE  VALUES  CALCULATED  IN  SUBROUTINE  DVAR.  IF  THE 

C  DENOMINATOR  OF  ONE  OF  THE  RATIOS  IS  ZERO,  AND  THE  NUMERATOR  IS 

C  NONZERO,  THAT  RATIO  IS  SET  TO  A  BIG  NUMBER.  IF  BOTH  NUMERATOR 

C  AND  DENOMINATOR  ARE  ZERO,  THE  RATIOS  IN  BOTH  DIRECTIONS  ARE  SET 

C  TO  ZERO. 

C 

PARAMETER  BIGNBR  -  1.0E+35 
IF(DVAR2.EQ.O.O)GO  TO  10 
RATIOl  -  DVAR1/DVAR2 
IF(DVAR1.EQ.0.0)G0  TO  20 
RATI02  -  DVAR2/DVAR1 
5  IF ( DVAR4 . EQ . 0 . 0 )G0  TO  30 

RATI03  «  DVAR3/DVAR4 
IF(DVAR3.EQ.O.O)GO  TO  40 
RATI04  -  DVAR4/DVAR3 
GO  TO  100 

10  IF(DVAR1.EQ.O.O)GO  TO  50 

RATIOl  -  BIGNBR 
RATI02  -  0.0 
GO  TO  5 

20  RATI02  •  BIGNBR 

GO  TO  5 

30  IF ( DVAR3 .EO.O.O)GO  TO  60 

RATI03  •  BIGNBR 
RATI 04  -  0.0 
GO  TO  100 

40  RAT 104  -  BIGNBR 

GO  TO  100 

50  RATIOl  -  0.0 

RATI 02  -  0.0 
GO  TO  5 

60  RATI03  -  0.0 

RATI04  -  0.0 
100  CONTINUE 

D  WRITE  (6,101)  RATIOl, RAT I 02 , RATIOS, RATI04 

D101  PORMAT( IX, 'RATIOl  -  ' ,G1 5. 7,2X, 'RATI02  -  ' ,C15.7,2X, 'RATI03  -  ' 

D  1,G15.7,2X, 'RATI04  -  ',C15.7,/) 

RETURN 

END 
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SUBROUTINE  I0P4(I0PERR) 

TYPE  * , ' IOP4  MOT  AVAILABLE  AT  THIS  TIME' 

RETURN 

END 


SUBROUTINE  IOP5(IOPERR) 

TYPE  *,'IOP5  NOT  AVAILABLE  AT  THIS  TIME' 

RETURN 

END 


SUBROUTINE  IOP6(IOPERR) 

TYPE  *,'IOP6  NOT  AVAILABLE  AT  THIS  TIME' 

RETURN 

END 


SUBROUTINE  IOP7(IOPERR) 

TYPE  *,'IOP7  MOT  AVAILABLE  AT  THIS  TIME' 

RETURN 

END 


SUBROUTINE  IOP8(IOPERR) 

TYPE  *,'IOP8  NOT  AVAILABLE  AT  THIS  TIME' 

RETURN 

END 


SUBROUTINE  IOP9(IOPERR) 

TYPE  *,'IOP9  NOT  AVAILABLE  AT  THIS  TIME' 

RETURN 

END 


SUBROUTINE  IOPIO(IOPERR) 

TYPE  *,'IOP10  NOT  AVAILABLE  AT  THIS  TIME 

RETURN 

END 
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SUBROUTINE  IPSTOR(VALUE, IPSERR, IPSEND) 


C 

C  THIS  SUBROUTINE  STORES  THE  COMPUTED  INTERESTING  POINTS 

C  IN  THREE  ARRAYS.  ARRAY  IPR(*)  CONTAINS  THE  ROW  NUMBER 

C  OF  THE  INTERESTING  POINTS.  ARRAY  IPC(*)  CONTAINS  THE 

C  COLUMN  NUMBER  OF  THE  INTERESTING  POINTS.  ARRAY  VALUI?(*) 

C  CONTAINS  THE  VALUE  OF  THE  VARIANCE  AT  THE  INTERESTING 

C  POINT  LOCATION.  A  CORRELATION  WINDOW  IS  ALSO  STORED  AROUND 

C  EACH  INTERESTING  POINT  IF  MATCHING  IS  DESIRED  (IPFLAG-lj. 

C 

INCLUDE  ' COMMON. FTN' 

COMMON  /IOP/  IX, IPFLAG 
COMMON  /MOVE/  ROWKNT , COLKNT 
COMMON  /WINDOW/  X, XX, WNDRWH , WNDCLH 
COMMON  /IPS/  IPKNT, IPR(M) , IPC(M) , VALUIP(M) 

INTEGER  ROWKNT, COLKNT , X, XX, WNDRWH , WNDCLH 
D  WRITE  (6,*)  '***  ENTER  IPSTOR  ***' 

IPKNT  -  IPKNT  +  1 

***  DETERMINE  EACH  INTERESTING  POINT  LOCATION  *** 

IPROW  -  ROWKNT  +  WNDRWH 
IPCOL  -  COLKNT  +  WNDCLH 

***  STORE  THE  INTERESTING  POINT  INFORMATION  *** 

IPR( IPKNT)  -  IPROW 
IPC( IPKNT)  -  IPCOL 
VALUIP( IPKNT)  -  VALUE 

IF ( IPFLAG. EQ.O)GO  TO  5 

***  FORM  INTERESTING  POINT  CORRELATION  WINDOW  *** 

CALL  CWDOUT(IPROW, IPCOL, IPSERR) 

IF (I PS ERR. EQ . 1 )RETURN 
C 

5  IF ( IPKNT , GE . M)GO  TO  40 

RETURN 

40  WRITE  (6,*)'  ' 

WRITE  (6,*)'***  INTERESTING  POINT  STORAGE  LIMIT  EXCEEDED  ***' 

WRITE  (6,*)'  ' 

WRITE  (6,*)'****************************************************** 
1***' 

WRITE  (6,*)'***  WARNING:  ENTIRE  IMAGE  MAY  NOT  HAVE  BEEN  PROCESSED 

1***' 

WRITE  (6 , * ) 'a***************************************************** 
1***' 

WRITE  (6,*)'  ' 
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WRITE  (6,*) 'PROCESSING  TERMINATED  AT  WINDOW  POSITION  (CENTER) 
WRITE  (6,*)'  ' 

WRITE  (6,*)'  ROW  NUMBER  -  '.IPROW 
WRITE  (6,*)'  COLUMN  NUMBER  -  '.IPCOL 
WRITE  (6,*)'  ' 

TYPE  ' 

TYPE  *,'***  INTERESTING  POINT  STORAGE  LIMIT  EXCEEDED  ***' 

IPSEND  -  1 

RETURN 

END 
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SUBROUTINE  CWDOUT(IPROW, IPCOL.CWDERR) 


C 

C  THIS  SUBROUTINE  IS  USED  TO  STORE  THE  CORRELATION  WINDOWS 

C  SURROUNDING  EACH  INTERESTING  POINT  ON  A  TEMPORARY  SCRATCH 

C  FILE. 

C 

INCLUDE  'COMMON. FTN' 

COMMON  /CWFILE/  LUNCW 

COMMON  /CORWND/  IW, IX, IY, IZ .CWDSZE 

COMMON  /IPS/  IPKNT, IPR(M) ,I?C(M) ,X(M) ,IPWND(M/3) 

INTEGER  CWDSZE, CWDERR 

***  OBTAIN  THE  CORRELATION  WINDOW  FOR  EACH  INTERESTING  POINT  *** 

CALL  CORWND(IPROW, IPCOL.CWDERR) 

IF(CWDERR. EO. 1 )RETURN 

***  OUTPUT  EACH  CORRELATION  WINDOW  *** 

WRITE(LUNCW,10,ERR-100)(IPWND(I),I-1 .CWDSZE) 

0  FORMAT( <CWDSZE>I3 ) 

RETURN 

100  TYPE  ' 

TYPE  *,'***  WRITE  ERROR  OCCURED  IN  CWDOUT  ON  LOGICAL  UNIT', LUNCW, 
1'  ***' 

CLOSE (UNIT-LUNCW , DI SPOSE- ' DELETE ' ) 

CALL  CLOSKP( CWDERR) 

CWDERR  -  1 

WRITE  (6,*)  '***  EXIT  CWDOUT  -  WRITE  ERROR  TERMINATION  ***' 

RETURN 

END 
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SUBROUTINE  CORWND(IPROW, IPCOL, CORERR) 

THIS  SUBROUTINE  FORMS  A  CORRELATION  WINDOW  AROUND  EACH  INTEREST 
ING  POINT  OF  A  SIZE  DETERMINED  BY  THE  USER  IN  SUBROUTINE  CWDSZE 
IF  THE  CORRELATION  WINDOW  EXTENDS  BEYOND  THE  EDGES  OF  THE  IMAGE 
FOR  POINTS  CLOSE  TO  THE  EDGE,  THE  PIXELS  OUTSIDE  THE  IMAGE  AREA 
BECOME  "PSEUDO-PIXELS",  AND  TAKE  ON  THE  VALUE  OF  THEIR  CORRES¬ 
PONDING  PIXEL  ON  THE  IMAGE  EDGE. 

INCLUDE  ' COMMON. FTN' 

COMMON  /IBUF/  IBUF(M) 

COMMON  /INBUF/  INTBUF(M) 

COMMON  /IMAGE/  IMGROW. IMGCOL 

COMMON  /CORWND/  CWDROW , CWDCOL ,  CWDRWH , CWDCLH 

COMMON  /IPS/  IX, IPR(M) , IPC(M) ,X(M) , IPCWND(M/3) 

INTECE R  CWDROW , CWDCOL,  CWDRWH , CWDCLH , CORERR 
INTEGER  CWDRWS , CVDCLS , CWDRWE , CWDCLE, RECNUM 
LOGICAL* 1  IBUF 

WRITE  (6,*)  '***  ENTER  CORWND  ***' 

***  FIND  CORRELATION  WINDOW  STAPT  AND  END  LOCATIONS  *** 

CALL  CWDTST( IPROW , IPCO L, CWDRWS , CWDCLS , CWDRWE , CWDCLE ) 

RECNUM  -  IPROW  -  CWDRWH  +  CWDRWS 
IPCKNT  -  CWDCOL* (CWDRWS- i)  +  1 
IMCLST  -  IPCOL  -  CWDCLH 

***  INPUT  IMAGE  INTENSITY  VALUES  *** 

CALL  INBUFR( RECNUM, CORERR) 

IF ( CORERR. EO • 1 )RETURN 

***  PERFORM  BYTE  TO  WORD  NUMBER  CONVERSION  *** 

DO  2  J-l, IMGCOL 
INTBUF(J)  -  IBUF(J) 

IF(INTBUF(J).LT.O)INTBUF(J)  -  INTBUF(J)  +  256 
CONTINUE 

IF ( CWDCLS. GT. I )GO  TO  10 

***  FORM  MIDDLE  WINDOW  ROW  ELEMENTS  *** 

DO  4  K-CWDCLS, CWDCLE 

IPCWND( IPCKNT)  -  INTBUF( IMCLST+K) 

IPCKNT  -  IPCKNT  +  1 
CONTINUE 


IF ( CWDCL E . LT . CWDCO L ) CO  TO  20 

5  IF(CWDRWS.GT. l)GO  TO  30 

6  IF(CWDRWE. OT .  1  .AND.RECNUM.EO. IMGROW)CO  TO  40 
RECNU11  -  RECNLM  +  1 
IF(RECNUM.EO.IPROW+CWDRWH)GO  TO  50 

CO  TO  1 
C 

C  ***  FORM  LEFT  WINDOW  ROW  ELEMENTS  *** 

C 

10  DO  11  K-l.CWDCLS-l 
IPCWND(IPCKNT)  -  INTBUF(l) 

IPCKNT  -  IPCKNT  +  1 

1 1  CONTINUE 
GO  TO  3 

C 

C  ***  FORM  RIGHT  WINDOW  ROW  ELEMENTS  *** 

C 

20  DO  21  K-CWDCLE+1 ,CWDC0L 
IPCWND( IPCKNT)  -  INTBUF(IMCCOL) 

IPCKNT  -  IPCKNT  +  1 

2 1  CONTINUE 
GO  TO  5 

C 

C  ***  FORM  WINDOW  ROWS  ABOVE  IMAGE  *** 

C 

30  IPCKNT  «  1 

IMRWST  «  CWDCOL* (CWDRUS-i ) 

DO  31  J-l.CWDRWS-l 
DO  31  K-l, CWDCOL 

IPCWND( IPCKNT)  -  IPCWND( IMRWST+K ) 

IPCKNT  -  IPCKNT  +  1 

31  CONTINUE 

IPCKNT  -  CWDCO L*CWDRWS  +  1 

CWDRWS  -  1 

GO  TO  6 
C 

C  ***  FORM  WINDOW  ROWS  BELOW  IMAGE  *** 

C 

40  IMRWED  -  CWDCOL* (CWDRWE-1 ) 

DO  41  J-CWDRWE+1 , CWDROW 

DO  41  K-l, CWDCOL 

IPCWND( IPCKNT)  -  IPCWND( IMRWED+K ) 

IPCKNT  -  IPCKNT  +  1 

41  CONTINUE 

50  CONTINUE 

C 

C  ***  PRINT  CORRELATION  WINDOW  *** 

C 

D  IPCSZE  -  CWDR0W*CWDC0L 

D  WRITE  (6,*)  '  ' 
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WRITE  (6,*)  'CORRELATION’  WINDOW  FOR  INTERESTING  POINT: ' , IPROW, 

r , ' , ipcol 

WRITE  (6,51) 

51  F0RMAT(1X,57( )) 

WRITE  ( 6 , 52 ) ( IPCWND( I ) , I- 1 , IPCSZE) 

52  FORMAT( <CWDCOL>( 2X, 13 ) ) 

WRITE  (6,*)  '  ' 

RETURN 

END 
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SURROUT  IHF.  CWD?ST(  I  PROW ,  IPCOL  .CWDRWS ,  CVDCLS ,  CWDRWE ,  CWDCLE) 

THIS  SUBROUTINE  TESTS  THE  POSITION  OF  THE  CORRELATION  WINDOW  WITH 
RESPECT  TO  THE  IMAGE  TO  DETERMINE  IF  THE  IMAGE  BOUNDARY  HAS  BEEN 
EXCEEDED.  IF  SO,  THE  CORRELATION  WINDOW  ROW  AND  COLUMN  START  AND 
STOP  LOCATIONS  ARE  DETERMINED  WITH  RESPECT  TO  THE  IMAGE. 

COMMON  /IMAGE/  IMGROW, IMGCOL 
COMMON  /CORWND/  CWDROW , CWDCOL, CWDRWH , CWDCLH 
INTEGER  CWDROW , CWDCOL , CWDRWH , CWDCLH 
INTEGE  R  CWDLCL , CWDTRW , CWDRCL , CWDBRW 
INTEGER  CWDRWS, CWDRWE, CWDCLS, CWDCLE 
WRITE  (6,*)  '***  ENTER  CWDTST  ***' 

***  TEST  FOR  LEFT  COLUMN  OF  IMAGE  *** 

CWDLCL  -  IPCOL  -  CWDCLH 
IF ( CWDLCL. LT.O)GO  TO  10 
CWDCLS  -  1 

***  TEST  FOR  TOP  OF  IMAGE  *** 

CWDTRW  -  I PROW  -  CWDRWH 
IF( CWDTRW . LT. 0 )G0  TO  20 
CWDRWS  -  1 


***  TEST  FOR  RIGHT  COLUMN  OF  IMAGE  *** 

CWDRCL  -  IMGCOL  -  (IPCOL+CWDCLH)  +  I 
IF(CWDRCL.LT. 0)GO  TO  30 
CWDCLE  -  CWDCOL 

***  TEST  FOR  BOTTOM  OF  IMAGE  *** 

CWDBRW  -  IMGROW  -  (IPROW+CWDRWH)  +  1 
IF ( CWDBRW. LT.OJGO  TO  40 
CWDRWE  -  1 

RETURN 

***  DETERMINE  COLUMN  START  POSITION  *** 

CWDCLS  -  1  -  CWDLCL 
GO  TO  2 

***  DETERMINE  ROW  START  POSITION  *** 


CWDRWS  -  1  -  CWDTRW 
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SUBROUTINE  INBUFR(RECNUM,  INBF.RR) 

THIS  SUBROUTINE  INPUTS  ONE  RECORD  FROM  THE  FIEF.  ASSIGNED  TO 
LOGICAL  UNIT  NUMBER  LUN  AND  STORES  IT  IN  ARRAY  IBUF. 

INCLUDE  'COMMON. FTN' 

COMMON  /IBUF/  IBUF(M) 

COMMON  /FILE/  LUN 
COMMON  /IMAGE/  IX.IMGCOL 
LOGICAL* 1  IBUF 
INTEGER  RECNUM 

***  READ  THE  FILE  RECORD  *** 

READ(LUN'RECNUM, END-1 0, ERR-1 00) (IBUF( I ) , 1-1 , IMGCOL) 

CONTINUE 
RETURN 
TYPE  *,'  ' 

TYPE  *,'***  READ  ERROR  OCCURED  IN  INBUFR  OH  LOGICAL  UNIT', LUN, 
1 '  *** ' 

CALL  CLOSKP(INBERR) 

INBERR  -  1 

WRITE  (6,*)  '***  EXIT  INBUFR  -  READ  ERROR  TERMINATION  ***' 

RETURN 

END 


SUBROUTINE  IPLST 


THIS  SUBROUTINE  LISTS  THE  ROW  AND  COLUMN  POSITIONS  AND  VALUE 
OF  EACH  INTERESTING  POINT  AFTER  INTERESTING  POINT  PROCESSING 
IS  COMPLETE. 

INCLUDE  ' COMMON. FTN' 

COMMON  /IPS/  IPKNT, IPR(M) , IPC(M) , VALUIP(M) 

***  LIST  THE  INTERESTING  POINTS  *** 

TYPE  ' 

TYPE  *,'***  INTERESTING  POINT  PROCESSING  COMPLETE  ***' 

WRITE  (6,*)  '  ' 

WRITE  (6,*)  'HERE  IS  THE  LIST  OF  INTERESTING  POINT  LOCATIONS 

WRITE  (6,*)  ' - 

DO  30  I- 1, IPKNT 

WRITE  (6,20)  I , IPR(I) , IPC(I ) , I , VALUIP(I) 

F0RMAT(3X, 'IP( ' , 13, ' )  -  ' , 13, ' , ' ,I3,5X, 'IPMAG( ' ,13, ' )  -  ',F1( 

CONTINUE 

WRITE  (6,*)  '  ' 

WRITE  (6,*)  '  ' 

RETURN 
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Appendix  E_:  Interesting  Point  "latching  Section 

This  appendix  contains  the  FORTRAN  source  listing  for  the  Interesting 
Point  Matching  Section  of  program  DIDA. 


SUBROUTINE  IPMTCH(STORE,  IP11ERR,  IPMEND) 

C 

C  THIS  SUBROUTINE  ALLOWS  THE  USER  TO  OPEN  THE  FILES  AND  INPUT  THE 

C  TWO  SETS  OF  INTERESTING  POINTS  FROM  IMAGE  1  AND  IMAGE  2  TO  BE 

C  MATCHED.  THE  MATCHING  ALGORITHM  IS  THEN  SELECTED  AND  THE  MATCH' 

C  IMG  PROCESS  BEGINS.  WHEN  COMPLETED,  THE  MATCHED  POINTS  ARE 

C  LISTED  ON  THE  PRINTER. 

C 

COMMON  /IFILE1/  LUN1 
COMMON  /IFILE2/  LUN2 
WRITE  (6,*)  '***  ENTER  IPMTCH  ***' 

***  OPEN  THE  FILES  OF  THE  TWO  SETS  OF  INTERESTING  POINTS  TO 
BE  INPUT  *** 

CALL  IPSOPN(IPMERR, IPMEND) 

IF ( IPME  RR. EO . 1 . OR. IPMEND. EQ . 1 ) R  ETURN 

***  SELECT  THE  MATCHING  ALGORITHM  *** 

CALL  MTASEL(STORE, IPMERR, IPMEND) 

IF ( IPME RR. EQ . 1 . OR. IPMEND. EQ . 1 )RETURN 

***  LIST  THE  MATCHED  POINTS  *** 

CALL  MPLST(STORE) 

C 

ClOSE(UNIT-LUNl .DISPOSE- 'KEEP' ) 

CLOSE (UNIT-LUN2 , DISPOSE- 'KEEP ' ) 

RETURN 

END 


SUBROUTINE  IPSOPN(IPSERR, IPSEND) 

C 

C  THIS  SUBROUTINE  OPENS  THE  FILES  OF  THE  TWO  SETS  OF  INTERESTING 

C  POINTS  TO  BE  INPUT  FOR  MATCHING.  THE  FIRST  RECORD  OF  EACH  FILE 

C  IS  THEN  INPUT  AND  STORED  IN  A  COMMON  AREA.  A  COMPARISON  OF  THE 

C  TWO  SETS  IS  THEN  PERFORMED  TO  ALLOW  THE  USER  TO  DECIDE  IF  THE 

C  MATCHING  PROCESS  SHOULD  CONTINUE. 

C 

COMMON  /IFILE1/  LUN1 
COMMON  /IFILE2/  LUN2 

COMMON  /IPS1/  IPKNT1 ,IPTYP1 ,CWROWl ,CWCOLI ,CWSZE1 
COMMON  /IPS2/  IPKNT2 , IPTYP2 , CWROW2 , CWCOL2 , CWSZE2 
INTEGER  CWROW1  .CWCOLl  .CWSZEI  .CWROW2  .CWC0L2  .CWSZE2 
D  WRITE  (6,*)  '***  ENTER  IPSOPN  ***' 

TYPE  ' 

TYPE  *, 'ENTER  THE  LOGICAL  UNIT  NUMBER  AND  FILE  NAME  YOU  WISH  TO 
TYPE  *, 'USE  TO  INPUT  THE  FIRST  SET  OF  INTERESTING  POINTS:' 

C 

C  ***  ENTER  THE  LOGICAL  UNIT  NUMBER  AND  FILE  NAME  *** 

C 

CALL  IF  1 FLU 
C 

C  ***  OPEN  THE  FILE  FOR  INTERESTING  POINT  SET  1  *** 

C 

CALL  OPNIF 1(IPS ERR) 

IF ( I PSERR. EQ . 1 ) RETURN 
C 

C  ***  READ  THE  FIRST  RECORD  *** 

C 

READ(LUN1,1, END-10, ERR-100)  IPKNTI .IPTYPl .CVROWl .CWCOLl .CWSZEI 
I  FORMAT(5I3) 

C 

10  TYPE  ' 

TYPE  *, 'ENTER  THE  LOCICAL  UNIT  NUMBER  AND  FILE  NAME  YOU  WISH  TO 
TYPE  *, 'USE  TO  INPUT  THE  SECOND  SET  OF  INTERESTING  POINTS:' 

C 

C  ***  ENTER  THE  LOGICAL  UNIT  NUMBER  AND  FILE  NAME  *** 

C 

CALL  IF2FLU 
C 

C  ***  OPEN  THE  FILE  FOR  INTERESTING  POINT  SET  2  *** 

C 

CALL  0PNIF2(IPSERR) 

IF ( IPS  ERR. EQ . 1 )RETUEN 
C 

C  ***  READ  THE  FIRST  RECORD  *** 

C 

READ(LUN2, 1 , END-2 O.ERR-2 00)  IPKNT2 .IPTYP2 , CWR0W2 , CWC0L2 .CWSZE2 
C 
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REWIND  LUN2 
TYPE  *,'  ' 

TYPE  *, 'HERE  IS  THE  COMPARISON  BETWEEN  INTERESTING  POINT  SETS' 

TYPE  *, 'ONE  AND  TWO:' 

TYPE  ' 

TYPE  *,'  IP  SET  1  IP  SET  2' 

TYPE  -  - ' 

TYPE  *, 'NUMBER  OF  POINTS  -  '.IPKNT1,'  NUMBER  OF  POINTS  -  ' , IPKNT2 

TYPE  *, 'TYPE  INTEREST  OP  -  '.IPTYP1,'  TYPE  INTEREST  OP  -  ' , IPTYP2 

TYPE  *,  'COR  WINDOW  ROWS  -  '.CWROWl,'  COR  WINDOW  ROWS  -  '.CWR0W2 

TYPE  *, 'COR  WINDOW  COLS  -  '.CWCOLl,'  COR  WINDOW  COLS  -  '.CWC0L2 

TYPE  *, 'COR  WINDOW  SIZE  ■  '.CWSZEl,'  COR  WINDOW  SIZE  -  ' , CUSZE2 

TYPE  *,'  ' 

TYPE  *, 'NOTE:  IT  IS  NOT  NECESSARY  FOR  THE  CORRELATION  WINDOW  ROW,' 
TYPE  *, 'COLUMN,  OR  OVERALL  SIZES  TO  MATCH  TO  PERFORM  MATCHING!' 
TYPE  ' 

TYPE  *, 'DO  YOU  WISH  TO  CONTINUE  WITH  THE  MATCHING  PROCESS?' 

TYPE  *, 'IF  YOU  DO,  TYPE  YES.  OTHERWISE,  TYPE  NO.' 

TYPE  *,'  ' 

TYPE  30 

30  F0RMAT(5X, 'ANSWER  -  ',S) 

ACCEPT  40 .ANSWER 
40  F0RMAT(A3) 

CALL  ANSCHK( ANSWER) 

IF(ANSWER.EQ. 'YES' )RETURN 
CLOSE( UNIT-LUN  1 ,  DISPOSE- 'KEEP '  ) 

CL0SE(UNIT-LUN2 , DISPOSE- 'KEEP ' ) 

IPS END  -  1 
RETURN 

100  TYPE  ' 

TYPE  *,'***  READ  ERROR  OC CURED  IN  IPSOPN  ON  LOGICAL  UNIT' ,  LTTNl , 

1'  ***' 

CL0SE(UNIT-LUN1 , DISPOSE- 'KEEP' ) 

IPS ERR  -  1 

WRITE  (6,*)  '***  EXIT  IPSOPN  -  READ  ERROR  TERMINATION  ***' 

RETURN 

200  TYPE  *,'  ' 

TYPE  *,'***  READ  ERROR  OCCURED  IN  IPSOPN  ON  LOGICAL  UNIT',LUN2, 
***' 

CL0SF.(UNIT-LUN1 ,  DISPOSE- ' KEEP '  ) 

CL0SE(UNIT-LUN2 .DISPOSE- 'KEEP ' ) 

IPS ERR  -  1 

WRITE  (6,*)  '***  EXIT  IPSOPN  -  READ  ERROR  TERMINATION  ***' 

RETURN 

END 
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SUBROUTINE  IF2FLU 


THIS  SUBROUTINE  ALLOWS  THE  USER  TO  ENTER  THE  LOGICAL  UNIT 
NUMBER  AND  FILE  NAftE  INTERACTIVELY  FOR  INTERESTING  POINT 
SET  INPUT/OUTPUT  OPERATIONS.  THE  USER  MAY  CORRECT  THIS 
INFORMATION  IF  AN  ENTRY  ERROR  OCCURS. 

COMMON  /IFILE2/  LUN2 , NCHAR2 , FNAME2 ( 34 ) 

LOGICAL* 1  FNAME2 

***  ENTER  THE  LOGICAL  UNIT  NUMBER  AND  FILE  NAME  *** 

CALL  LUNBR2 
CALL  FILNM2 

***  OPTIONAL  ENTRY  INFORMATION  CHECK  *** 

TYPE  *,'  ' 

TYPE  *, 'DO  YOU  WISH  TO  CHECK  FOR  ENTRY  ERRORS?' 

TYPE  *, 'IF  YOU  DO,  TYPE  YES.  OTHERWISE,  TYPE  NO.' 

TYPE  *,'  ' 

TYPE  I 

FORMAT(5X, 'ANSWER  -  ',$) 

ACCEPT  2, ANSWER 
FORMAT(A3) 


***  CHECK  ANSWER  ENTRY  *** 

CALL  ANSCHK( ANSWER) 

IF(ANSWER.EQ.'NO')GO  TO  3 

***  CHECK  ENTRY  INFORMATION  *** 

CALL  IF2CHK 
C 

3  WRITE  (6,*)  '  ' 

WRITE  (6,*)  '***  INTERESTING  POINT  SET  2  FILE  INFORMATION  ***' 
WRITE  (6,*)  '  ' 

WRITE  (6,*)  'LOGICAL  UNIT  NUMBER  -  ',LUN2 
WRITE  (6,4)  (FNAME2 (I ) , I»1 , NCHAR2 ) 

4  PORMAT(  IX, 'FILENAME  -  \<NCHAR2+1>A1) 

WRITE  (6,*)  '  ' 

RETURN 

END 
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SUBROUTINE  IF2CHK 


C 

C  THIS  SUBROUTINE  ALLOWS  THE  USER  TO  CHECK  THE  INFORMATION 

C  IffPUT  FOR  THE  FILE  NAflE  AND  LOGICAL  UNIT  Nl!MBER,  AND  TO 

C  CORRECT  THEM  IF  DESIRED. 

C 

COMMON  /IFILE2/  LUN2 , NCHAR2 , FNAME2 ( 34 ) 

LOGICAL*!  FNAME2 
1  TYPE  *,'  ' 

TYPE  *, 'HERE  IS  WHAT  YOU  HAVE  INPUT:' 

TYPE  *,'  ' 

***  DISPLAY  THF.  FILE  NAME  AND  LOGICAL  UNIT  NUMBER  INPUT  *** 

TYPE  *,' LOGICAL  UNIT  NUMBER  -  ',LUN2 
TYPE  2,(FNAME2(I),I-1 .NCHAR2) 

FORMAT( IX, 'FILENAME  -  ' ,<NCHAR2+1>A1 ) 

***  VERIFY  THE  CORRECT  RESPONSE  *** 

CALL  VERIFY (ANSWER) 

IF(ANSWER.EQ. 'YES' )GO  TO  3 

***  CHANGE  INCORRECT  INFORMATION  *** 

CALL  IF2COR 
C 

GO  TO  1 
3  RETURN 

END 
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SUBROUTINE  IF2COR 

THIS  SUBROUTINE  ALLOWS  THE  USER  TO  CORRECT  THE  INFORMATION 
INPUT  FOR  THE  FILE  NAME  AND  LOGICAL  UNIT  NUMBER. 

REAL  ITEM 

***  MAKE  ERROR  CORRECTIONS  *** 


TYPE  ' 

TYPE  * , 'DO  YOU  WANT  TO  CHANGE  THE  LOGICAL  UNIT  NUMBER, ' 

TYPE  *, 'FILE  NAME,  OR  BOTH?' 

TYPE  *, 'IF  YOU  WANT  TO  CHANGE  THE  LOCICAL  UNIT  NUMBER,  TYPE  LUN. ' 
TYPE  *, ' IF  YOU  WANT  TO  CHANGE  THE  FILE  NAME ,  TYPE  FILE.' 

TYPE  *, ' IF  YOU  WANT  TO  CHANCE  BOTH,  TYPE  BOTH.' 

TYPE  ' 

TYPE  2 

FORMAT(5X, 'ITEM  YOU  WISH  TO  CHANGE  -  ',$) 

ACCEPT  3, ITEM 
FORMAT (A4 ) 

IF ( ITEM. EQ. 'BOTH' )GO  TO  10 
IF(ITEM.EQ.'LUN')GO  TO  20 
IF ( ITEM. EQ. 'FILE' )G0  TO  30 
TYPE  ' 

TYPE  *,'***  ITEM  ENTRY  ERROR  -  PLEASE  RETYPE  ***' 

TYPE  *,'  ' 

GO  TO  1 

***  CHANGE  BOTH  FILE  NAME  AND  LOGICAL  UNIT  NUMBER  *** 

CALL  FILNM2 
CALL  LHKBR2 
RETURN 

***  CHANGE  LOGICAL  UNIT  NUMBER  *** 

CALL  LUNBR2 
RETURN 

***  CHANCE  FILE  NAME  *** 

CALL  FILNM2 
RETURN 
END 
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SUBROUTINE  FIL.NM2 


THIS  SUBROUTINE  ALLOWS  THE  USER  TO  INPUT  THE  FILE  NAME  OF 
THE  FILE  BEING  USED  FOR  INTERESTING  POINT  SET  INPUT/OUTPUT 
OPERATIONS. 

COMMON  /IFILE2/  IX,NCHAR2,FNAME2(34) 

LOGICAL* 1  FNAME2 
TYPE  *,'  ' 

TYPE  * , ' WHAT  DEVICF./UIC/ FILENAME  DO  YOU  WISH  TO  USE?' 

TYPE  *, 'ENTER  ACCORDING  TO  THE  FOLLOWING  FORMAT : ' 

TYPE  *,'  ' 

TYPE  *,'  DEV : [  UIC  J FILENAME. TYPE; VERS ION' 

TYPE  *, 'EXAMPLE;  DK1 : [ 10.20IFILENAME. IMG; 3' 

TYPE  *,'  ' 

***  INPUT  THE  DESIRED  FILE  NAME  *** 

TYPE  1 

1  FORMAT(5X, 'FILENAME  -  ',$) 

ACCEPT  2 , NCHAR2 , FNAME2 

2  F0RMAT(Q,34A1) 

FNAME2 (NCHAR2+1 )  -  0 

C 

RETURN 

END 
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SUBROUTINE  LUNBR2 


C 

C  THIS  SUBROUTINE  ALLOWS  THE  USER  TO  INPUT  THE  LOGICAL  UNIT 

C  NUMBER  ASSOCIATED  WITH  THE  FILE  TO  BE  USED  FOR  INTERESTING 

C  POINT  SET  INPUT/OUTPUT  OPERATIONS. 

C 

COMMON  /IFILE1/  LUN1 
COMMON  /IFILE2/  LUN2 
1  TYPE  ' 

TYPE  * , ' WHAT  LOGICAL  UNIT  NUMBER  YOU  WISH  TO  USE  (1-10)?' 

TYPE  ' 

***  ikput  THE  DESIRED  LOGICAL  UNIT  NUMBER  *** 

TYPE  2 

FORMAT(5X, 'LOGICAL  UNIT  NUMBER  =  ',$) 

ACCEPT  * , LUN2 

***  CHECK  FOR  INCORRECT  NUMBER  *** 

IF(LHN2.LT. 1.0R.LUN2.0T. 10)GO  TO  3 
IF (LUN2 .  EQ .  5 )G0  TO  4 
IF(LUN2.EQ.6)GO  TO  5 
IF(LUN2.EQ.LUN1)G0  TO  6 
C 

RETURN 

3  TYPE  ' 

Type  *,'***  INVALID  LOGICAL  UNIT  NUMBER' ,L1TN2 , '  ATTEMPTED  *** 
TYPE  ' 

TYPE  *, 'LOGICAL  UNIT  NUMBER  MUST  BE  BETWEEN  1  AND  10.' 

GO  TO  1 

4  TYPE  ' 

TYPE  *. 'LOGICAL  UNIT  5  IS  RESERVED  FOR  THE  USERS  TERMINAL.' 
TYPE  *, 'PLEASE  USE  ANOTHER  NUMBER!' 

GO  TO  1 

5  TYPE  ' 

TYPE  *, 'LOGICAL  UNIT  6  IS  RESERVED  FOR  THE  LINE  PRINTER.' 

TYPE  *, 'PLEASE  USE  ANOTHER  NUMBER!' 

GO  TO  1 

6  TYPE  ' 

TYPE  *, 'LOGICAL  UNIT  NUMBER' ,LUN1 , '  ALREADY  IN  USE.' 

TYPE  *, 'PLEASE  USE  ANOTHER  NUMBER!' 

GO  TO  1 
END 
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SUBROUTINE  OPNIF2 (OPNERR) 


C 

C  THIS  SUBROUTINE  OPENS  A  FILE  FOR  INPUTTING  THE  SECOND  SET  OF  INT- 

C  ERESTING  POINTS  FOR  MATCHINC.  THE  FILE  IS  A  SEQUENTIAL  FORMATTED 

C  FILE. 

C 

INCLUDE  'COMMON. FTN' 

COMMON  /IFILE2/  LUN2  ,  IX,  FNAMF.2(  34) 

LOCICAL*l  FNAME2 
INTEGER  OPNERR 

***  OPEN  THE  FILE  *** 

OPEN(UNIT=L!'N2 , NAME-FNAME2 .DISPOSE- ' KEEP ' , RECORDS I2E-M+20 , 

1  TYPE- 'OLD', ERR- 100) 

C 

RETURN 

100  TYPE  ' 

TYPE  *,'***  OPEN  ERROR  OCCURED  IN  0PNIF2  ON  LOGICAL  HNIT',LUN2, 

1 '  *** ' 

CLOSE ( UNIT-LUN2 , DI SPO  S  E- ' KEEP ' , ERR-2  00 ) 

OPNERR  =  1 

WRITE  (6,*)  '***  EXIT  0PNIF2  -  OPEN  ERROR  TERMINATION  ***' 

RETURN 

200  TYPE  ' 

TYPE  *,'***  CLOSE  ERROR  OCCURED  IN  0PNIF2  ON  LOCICAL  UNIT',LUN2, 
1'  ***' 

OPNERR  -  1 

WRITE  (6,*)  '***  EXIT  0PNIF2  -  CLOSE  ERROR  TERMINATION  ***' 

RETURN 

END 
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SUBROUTINE  MTASEL( STORE, MTAERR, MTAEND) 

THIS  SUBROUTINE  ALLOWS  THE  USER  TO  SELECT  THE  ALGORITHM 
TO  BE  USED  TO  MATCH  THE  INTERESTING  POINTS  FROM  IMAGE  ONE 
TO  THOSE  IN  IMAGE  TWO. 


1 


5 


10 

20 

30 

40 

50 

60 

70 

100 


'ENTER  THE  NUMBER  CORRESPONDING  TO  THE  ALGORITHM  YOU  WISH' 
'TO  USE  TO  MATCH  THE  INTERESTING  POINTS:' 


TYPE 
TYPE 
TYPE 
TYPE 
TYPE 
TYPE 
TYPE 
TYPE 
TYPE 
TYPE 
TYPE 
TYPE 
TYPE 

F0RMAT(5X, 'ALGORITHM  NUMBER  -  #,S) 


1. 

2. 

3. 

4. 

5. 

6. 
7. 


RELAXATION-LABELING' 

NONE  YET' 

NONE  YET' 

NONE  YET' 

NONE  YET' 

TERMINATE  MATCHING  ALGORITHM' 
TERMINATE  PROGRAM  EXECUTION' 


ACCEPT  *,MTANBR 

IF(MTANBR.LT. 1 .0R.MTANBR.GT.7)G0  TO  100 
GO  T0( 10,20, 30,40, 50, 60, 70)MTANBR 
CALL  >TTALG1  (STORE,  MTAERR.MTAEND) 

RETURN 

CALL  MTALG2 (MTAERR) 

CO  TO  1 

CALL  MTALG3 (MTAERR) 

GO  TO  1 


CALL  MTALC4 (MTAERR) 

GO  TO  1 

CALL  MTALG5 (MTAERR) 

GO  TO  1 
RETURN 
MTAEND  -  1 
RETURN 
TYPE  ' 

TYPE  *,'***  INVALID  ALGORITHM  NUMBER' .MTANBR,  '  ATTEMPTED  ***' 

GO  TO  1 

END 
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SUBROUT  I  ME  MTALG1  (STORE  ,MTAERR,MTAF.ND) 


C 

C  THIS  SUBROUTINE  CONTROLS  THE  MATCHING  PROCESS  ASSOCIATED  WITH 

C  THE  RELAXATION-LABELING  MATCHING  ALGORITHM.  LABELS  ARE  DETER- 

C  MINED  FROM  THE  INITIAL  DISPARITIES  FORMED  BY  THE  TOO  SETS  OF 

C  INTERESTING  POINTS.  INITIAL  PROBABILITIES  ARE  FORMED  BY  COMP- 

C  ARING  CORRELATION  WINDOWS  SURROUNDING  EACH  INTERESTING  POINT 

C  BASED  ON  A  WEIGHTING  ALGORITHM  THE  USER  SELECTS.  THESE  PRO- 

C  BABILITIES  ARE  THEN  UPDATED  TO  FORM  THE  FINAL  PROBABILITIES. 

C 

INTEGER  CWTEST, W8ANBR 
WRITE  (6,*)  '***  ENTER  MTALG1  ***' 

***  DETERMINE  THE  DISPARITY  WINDOW  SIZE  *** 

CALL  DUDSZE 

***  DETERMINE  THE  ORIENTATION  OF  THE  CORRELATION  WINDOWS  *** 
CALL  CWCOMP< CWTEST) 

***  SELECT  THE  WEIGHTING  ALGORITHM  *** 

CALL  W8ASEL(W8ANBR,  MTAEND) 

IF(MTAEND.EQ . I )RETURN 

***  DETERMINE  THE  CONSTANT  FOR  THE  WEIGHING  ALGORITHM  *** 

IF(W8ANBR.EQ.6)GO  TO  1 
CALL  CONST(C) 

***  FORM  THE  ISABELS  AND  INITIAL  WEIGHTS  *** 

CALL  LABELS (STORE .CWTEST, W8 ANB R , C , MTAERR , MTAEND ) 

IF(MTAERR.EO.  1  .OR.  MTAEND.  EQ.  1  )RF.TURN 


***  FORM  INITIAL  PROBABILITIES  *** 

CALL  INPROB( STORE) 

***  DETERMINE  THE  CONSISTENCY  NEIGHBORHOOD  *** 

CALL  NGHSZE 

***  DETERMINE  THE  CONSTANTS  AND  THRESHOLD  FOR  UPDATING  THE 
LABEL  PROBABILITIES  *** 

CALL  CONSTS(A.B) 

CALL  THRESH(T) 
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***  UPDATE  THE  LAREL  PROBABILITIES  *** 

CALL  UDPROB(STORE,A, B,T) 

RETURN 

END 
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SUBROUTINE  DWDS2E 


C 

C  THIS  SUBROUTINE  ALLOWS  THE  USER  TO  DETERMINE  THE  NUMBER  OF 

C  ROWS  AND  COLUMNS  OF  THE  DISPARITY  WINDOW  TO  BE  USED  TO  FORM 

C  THE  LABELS  FOR  THE  MATCHING  ALGORITHM.  THE  USER  IS  ASKED  TO 

C  CHECK  THE  INPUT  INFORMATION  AND  MAKE  CORRECTIONS  IF  NECESSARY. 

C 

COMMON  /DSPWND/  DWDROW ,  DWDCO  L ,  DWDRWH ,  DWDCLH,  DWSZE ,  DUDINV 
INTEGER  DWDROW, DWDCOL.DWDRWH, DWDCLH, DWSZE 
TYPE  *,'  ' 

TYPE  *, 'PLEASE  TYPE  THE  NUMBER  OF  ROWS  AND  COLUMNS' 

TYPE  *,'OF  THE  DISPARITY  WINDOW: ' 

TYPE  ' 

***  ENTER  THE  NUMBER  OF  ROWS  AND  COLUMNS  OF  THE  WINDOW  *** 

CALL  DRCFND 

***COMPUTE  THE  WINDOW  SIZE  (NUMBER  OF  ROWS  X  NUMBER  OF  COLUMNS)*** 

DWSZE  -  OWDROW*DWDCOL 
DWDRWH  -  DWDROW/2 
DWDCLH  -  DWDCOL/2 

***  COMPUTE  THE  INVERSE  OF  THE  WINDOW  SIZE  *** 

DWDINV  -  l.O/DWSZE 
C 

WRITE  (6,*)  '  ' 

WRITE  (6,*)  '***  DISPARITY  WINDOW  INFORMATION  ***' 

WRITE  (6,*)  '  ' 

WRITE  (6,*)  'NUMBER  OF  DISPARITY  WINDOW  ROWS  -  '.DWDROW 
WRITE  (6,*)  'NUMBER  OF  DISPARITY  WINDOW  COLUMNS  -  '.DWDCOL 
WRITE  (6,*)  'DISPARITY  WINDOW  SIZE  (ROWSXCOLUMNS)  -  '.DWSZE 
WRITE  (6,*)  'INVERSE  OF  DISPARITY  WINDOW  SIZF  -  '.DWDINV 
WRITE  (6,*)  '  ' 

RETURN 

END 
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SUBROUT I ME  DRCFND 


C 

C  THIS  SUBROUTIME  ALLOWS  THE  USER  TO  ENTER  THE  NUMBER  OF  ROWS  AND 

C  COLU?!NS  INTERACTIVELY  FOR  THE  DISPARITY  WINDOW  TO  BE  USED  TO  FIND 

C  THE  LABELS  FOR  THE  MATCHING  ALGORITHM.  THE  USER  MAY  CORRECT  THIS 

C  INFORMATION  IF  AN  ENTRY  ERROR  OCCURS. 

C 

C  ***  ENTER  THE  NUMBER  OF  ROWS  AND  COLUMNS  *** 

C 

CALL  DWROW 
CALL  DWCOL 

***  OPTIONAL  ENTRY  INFORMATION  CHECK  *** 

TYPE  *,'  ' 

TYPE  *,'DO  YOU  WISH  TO  CHECK  FOR  ENTRY  ERRORS?' 

TYPE  *,  'IF  YOU  DO,  TYPE  YES.  OTHERWISE,  TYPE  NO.' 

TYPE  ' 

TYPE  1 

FORM AT ( 5X, 'ANSWER  -  ',S) 

ACCEPT  2 .ANSWER 
FORMAT(A3 ) 

***  CHECK  ANSWER  ENTRY  *** 

CALL  ANSCHK( ANSWER) 

IF ( ANSWER. EQ. 'NO' )GO  TO  3 

***  CHECK  ENTRY  INFORMATION  *** 

CALL  DRCCHK 
C 

3  RETURN 

END 
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SUBROUTINE  DRCCHK 


THIS  SUBROUTINE  ALLOWS  THE  USER  TO  CHECK  THE  INFORMATION 
INPUT  FOR  THE  NUMBER  OF  ROWS  AND  COLUMNS  OF  THE  DISPARITY 
WINDOW,  AND  TO  CORRECT  THEM  IF  DESIRED. 

COMMON  /DSPWND/  DWDROW , DWDCOL 
INTEGER  DWDROW, DWDCOL 
TYPE  ' 

TYPE  *, 'HERE  IS  WHAT  YOU  HAVE  INPUT:' 

TYPE  ' 

***  DISPLAY  THE  NUMBER  OF  WINDOW  ROWS  AND  COLUMNS  *** 

TYPE  *, 'NUMBER  OF  DISPARITY  WINDOW  ROWS  -  ', DWDROW 
TYPE  *, 'NUMBER  OF  DISPARITY  WINDOW  COLUMNS  -  '.DWDCOL 

***  VERIFY  THE  CORRECT  RESPONSE  *** 

CALL  VERIFY( ANSWER) 

IF(ANSWER.EO. 'YES' )GO  TO  2 

***  CHANGE  INCORRECT  INFORMATION  *** 

CALL  DRCCOR 
C 

GO  TO  1 
2  RETURN 

END 
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SUBROUTINE  DRCCOR 


THIS  SUBROUTINE  ALLOWS  THE  USER  TO  CORRECT  THE  INFORMATION 
INPUT  FOR  THE  NUMBER  OF  DISPARITY  WINDOW  ROWS  AND  COLUMNS. 

REAL  ITEM 

***  MAKE  ERROR  CORRECTIONS  *** 

TYPE  ' 

TYPE  *,  'DO  YOU  WANT  TO  CHANGE  THE  NUMBER  OF  ROWS,  COLUMNS,' 

TYPE  *, 'OR  BOTH?' 

TYPE  *, ' IF  YOU  WANT  TO  CHANGE  THE  NUMBER  OF  ROWS,  TYPE  ROWS. ' 

TYPE  *, 'IF  YOU  WANT  TO  CHANGE  THE  NUMBER  OF  COLUMNS,  TYPE  COLS. 

TYPE  *, 'IF  YOU  WANT  TO  CHANGE  BOTH,  TYPE  BOTH.' 

TYPE  *,'  ' 

TYPE  2 

FORMAT( 5X, ' ITEM  YOU  WISH  TO  CHANGE  -  ',$) 

ACCEPT  3, ITEM 
FORMAT(A4) 

IF( ITEM. EO. 'BOTH' )GO  TO  10 
IF(ITEM.EQ. 'ROWS' )GO  TO  20 
IF ( ITEM. EQ. 'COLS' )GO  TO  30 
TYPE  *,'  ' 

TYPE  *,'***  ITEM  ENTRY  ERROR  -  PLEASE  RETYPE  ***' 

TYPE  ' 

GO  TO  1 

***  CHANGE  BOTH  NUMBER  OF  ROWS  AND  COLUMNS  *** 

CALL  DWROW 
CALL  DWCOL 
RETURN 

***  CHANGE  NUMBER  OF  ROWS  *** 

CALL  DWROW 
RETURN 

***  CHANGE  NUMBER  OF  COLUMNS  *** 

CALL  DWCOL 

RETURN 

END 
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SUBROUTINE  DWROW 


THIS  SUBROUTINE  ALLOWS  THE  USER  TO  INPUT  THE  NUMBER  OF  ROWS 
OF  THE  DISPARITY  WINDOW. 

INCLUDE  'COMMON. FTN' 

COMMON  /DSPWND/  DWDROW 
INTEGER  DWDROW 

***  ENTER  THE  NUMBER  OF  WINDOW  ROWS  *** 

TYPE  1 

FORMAT(5X, 'NUMBER  OF  DISPARITY  WINDOW  ROWS  -  ',$) 

ACCEPT  * , DWDROW 
IF(DWDROW.CT.M)GO  TO  2 
IF (DWDROW.LT. 2 )G0  TO  3 

RETURN 
TYPE  ' 

TYPE  *,'***  MAXIMUM  WINDOW  ROW  SIZE'.M,'  EXCEEDED  IN  DWROW  ***' 
GO  TO  4 
TYPE  ' 

TYPE  *,'***  ROW  SIZE  SMALLER  THAN  2  (MINIMUM)  ATTEMPTED  ***' 

***  CORRECT  ROT/  SIZE  *** 

CALL  DRCCOR 

IF(OWDROW.GT.M)GO  TO  2 
IF ( DWDROW . LT. 2 )G0  TO  3 
RETURN 
END 
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SUBROUTINE  DWCOL 


THIS  SUBROUTINE  ALLOWS  THE  USER  TO  INPUT  THE  NUMBER  OF  COLUMNS 
OF  THE  DISPARITY  WINDOW. 

INCLUDE  ' COMMON. FTN' 

COMMON  /DSPWND/  X, DWDCOL 
INTEGER  DWDCOL, X 

***  ENTER  THE  NUMBER  OF  WINDOW  COLUMNS  *** 

TYPE  1 

F0RMAT(5X, 'NUMRER  OF  DISPARITY  WINDOW  COLUMNS  -  ',$) 

ACCEPT  *, DWDCOL 
IF(DWDCOL.GT.M)GO  TO  2 
IF(DWDCOL.LT.2)GO  TO  3 

RETURN 
TYPE  ' 

TYPE  *,'***  MAXIMUM  WINDOW  COLUMN  SIZE'  ,M, '  EXCEEDED  IN  DWCOL  ***' 
GO  TO  4 
TYPE  ' 

TYPE  *,'***  COLUMN  SIZE  LESS  THAN  2  (MINIMUM)  ATTEMPTED  ***' 

***  CORRECT  COLUMN  SIZE  *** 

CALL  DRCCHK 

IF ( DWDCOL. GT.M)GO  TO  2 
IF(DWDCOL.LT.2)GO  TO  3 
RETURN 
END 
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SUBROUTINE  CWCOMP(CWTEST) 

C 

C  THIS  SUBROUTINE  DETERMINES  THE  ORIENTATION  OF  ONE  CORRELATION 

C  WINDOW  WITH  RESPECT  TO  THE  OTHER.  IT  THEN  RETURNS  A  VALUE 

C  CORRESPONDING  TO  THIS  ORIENTATION. 

C 

COMMON  /IPS1/  IXl.IYl.CWROWl.CWCOLl 
COMMON  /IPS2/  1X2 , I Y2 , CWROW2 , CVCOL2 
INTEGER  CVROW 1 , CWCOL1 , CNROW2 , CWCOL2 ,  CWTEST 
D  WRITE  (6,*)  '***  ENTER  CWCOMP  ***' 

C 

C  ***  DETERMINE  RELATIVE  CORRELATION  WINDOW  ORIENTATIONS  *** 

C 

IF( CVROW 1.EO.CWROW2. AND. CWCOLI.EQ.CWCOL2)  cwtf.st  -  0 
IF(CWROWl  .GT. CWROW2  .AND.  CV/COL1  .OT.  CWCOL2  )  COTEST  -  1 
IF ( CVROW 1 .  LT.  CWROW2 . AND.  CWCOL1 . LT.  CWCOL2  )  COTEST  -  2 
IF(CWR0W1 .GT. CWROW2 .AND.CWCOL1 -LT.CWCOL2)  COTEST  -  3 
IF(CWROWl  .LT. CWROV2  .AND.CWCOL1  .GT.  CWCOL2  )  COTEST  -  4 
IF(CVROWl.Eq.CWROW2.AND.CVCOLl.GT.CWCOL2)  COTEST  -  5 
IF< CVROW 1.EQ.CVROW2. AND. CWCOL1 .LT.CWCOL2)  COTEST  -  6 
IF(CWROWi .GT. CWROW2 .AND.CVCOL1 .EO.CWCOL2 )  COTEST  -  7 
IF(CWROWl .LT.CWROW2 .AND.CWCOL1 .EQ.CWCOL2)  COTEST  -  8 
C 

RETURN 

END 
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SUBROUTINE  W8ASEL(W8AHBP.,  W8AEND) 


C 

1 


5 


10 


THIS  SUBROUTINE  ALLOWS  THE  USER  TO  SELECT  THE  WEIGHTING 
ALGORITHM  TO  BE  USED  TO  CALCULATE  THE  WIGHTS  ASSOCIATED 
WITH  THE  INITIAL  PROBABILITIES  FOR  HATCHING. 


INTEGER  W8AMB R, W8AEND 


TYPE 

* 

TYPE 

★ 

TYPE 

* 

TYPE 

* 

TYPE 

* 

TYPE 

it 

TYPE 

it 

TYPE 

it 

TYPE 

it 

TYPE 

it 

TYPE 

it 

TYPE 

* 

TYPE 

5 

'ENTER  THE  NUMBER  CORRESPONDING  TO  THE  WEIGHTING* 
'ALGORITHM  YOU  WISH  TO  USE:' 

t  0 

'  1.  SUM  OF  SQUARES  OF  PIXEL  DIFFERENCES' 

'  2.  AVERAGE  DIFFERENCE' 

'  3.  CENTER-MINUS-AVERAGE  DIFFERENCE' 

'  4.  GRADIENT  DIFFERENCE' 

'  5.  VARIANCE  DIFFERENCE' 

'  6.  STATISTICAL  CORRELATION' 

'  7.  TERMINATE  PROGRAM  EXECUTION' 


F0RMAT(5X, 'WEIGHTING  ALGORITHM  NUMBER  -  ',$) 

ACCEPT  *,W8ANRR 

IF(W8ANBR.LT. 1 .OR. W8ANBR.GT. 7 )G0  TO  10 
IF ( W8ANBR. EQ . 7 )W8AEND  -  1 
RETURN 
TYPE  ' 

TYPE  *,'***  INVALID  ALGORITHM  NUMBER' .W8ANBR, '  ATTEMPTED  ***' 

GO  TO  1 

END 
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SUB ROUT I NR  CONST(C) 


THIS  SUBROUTINE  ALLOWS  THE  USER  TO  INPUT  AN  ARBITRARY 
CONSTANT  TO  BE  USED  IN  THE  WEIGHTING  ALGORITHMS. 

TYPE  ' 

TYPE  *, 'WHAT  VALUE  OF  CONSTANT  (C)  DO  YOU  WISH  TO  USE' 

TYPE  *, 'FOR  THE  WEIGHTING  ALGORITHMS?' 

TYPE  ' 

TYPE  2 

FOKMAT(5X, 'WEIGHTING  CONSTANT  -  ',$) 

ACCEPT  *,C 

TYPE  ' 

TYPE  *, 'HERE  IS  WHAT  YOU  HAVE  INPUT:' 

TYPE  ' 

***  DISPLAY  THE  VALUE  OF  THE  CONSTANT  *** 

TYPE  *, 'WEIGHTING  CONSTANT  «  ',C 

***  VERIFY  THE  CORRECT  RESPONSE  *** 

CALL  VERIFY (ANSWER) 

C 

IF(ANSWER.EQ.'NO')GO  TO  1 
WRITE  (6,*)  '  ' 

WRITE  (6,*)  '***  CONSTANT  VALUE  FOR  WEIGHTING  ALGORITHMS  ***' 
WRITE  (6,*)  '  ' 

WRITE  (6,*)  'WEIGHTING  CONSTANT  -  ',C 
WRITE  (6,*)  '  ' 

RETURN- 

END 
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SUBROUTINE  I.ASFLS(STORE,  CWTEST,  W8ANBR, C .LABERR, IABEND) 

THIS  SUBROUTINE  COMPUTES  THE  LABELS  AND  WEIGHTS  FOR  THE  INITIAL 
PROBABILITIES  FOR  MATCHING.  THE  INTERESTING  POINTS  FROM  IMAGE 
TOO  WITHIN  THE  DISPARITY  WINDOW  OF  EACH  INTERESTING  POINT  FROM 
IMAGE  ONE  ARE  ASSIGNED  A  LABEL  OF  THE  DIFFERENCE  BETWEEN  THEIR 
ROW  AND  COLUMN  COORDINATE  VALUES.  A  WE IGHT  IS  THEN  ASSIGNED  TO 
EACH  CANDIDATE  MATCH  POINT  BASED  ON  THE  COMPARISON  OF  ITS  COR¬ 
RELATION  WINDOW  WITH  THAT  OF  THE  INTERESTING  POINT  IN  IMAGE  ONE. 

INCLUDE  'COMMON. FTN' 

VIRTUAL  STORE(N.M) 

COMMON  /IFILE1/  LUNI 
COMMON  /IFILE2/  LUN2 
COMMON  /REG1 /  IPCW1 (M/3) , IPCW2(M/3) 

COMMON  /REG2/  ITMP1 (M/3) , ITMP2 (M/3 ) 

COMMON  /IPS1/  IPKNT1 , IX, IY, IZ ,CWSZE1 
COMMON  /DSPWND/  DWDROW , DWDCOL , DWDRWH , DWDCLH 
INTEGER  CWTEST, W8ANBR, W8KNT,CWSZE,CWSZEI .CWSZE2 
INTEGE  R  DWDROW , DWDCOL , DWDRWH , DWDCLH , DRWFLC , DCLFLG 
INTEGE  R  DRWMI N , DRWMAX , DCLMIN , DCLMAX 
WRITE  (6,*)  '***  ENTER  LABELS  ***' 

LBLTST  -  (2*(N-4 ) )/3  +  3 
A  -  M/3 
B  -  SORT(A) 

IROW  -  B 

MDRTST  -  DWDROW  +  1 
MDCTST  -  DWDCOL  +  1 

***  INPUT  INTERESTING  POINTS  FROM  IMAGE  ONE  *** 

DO  20  J-l.IPKNTI 

READ(LUNI ,  1  , ERR- 100)  IPR0U1 ,  IPCOLI ,  XI ,  ( IPCWI  (1 1  )  ,  1 1-1 ,  CWSZE1 ) 
FORMAT(2I3 ,F10. 3 ,<CWSZE1>I3) 

READ(LUN2 , 2 , ERR-2 00)  IPKNT2 , IA , IB , IC , CWSZE2 
FORMAT(5I3) 

STORE(I.J)  -  I PROW 1 
STORE(2 , J)  -  IPCOLI 
W8KNT  -  LBLTST 
LBLKNT  »  0 
1-2 

***  FORM  DISPARITY  WINDOW  *** 

DR! /MIN  -  I  PROW  1  -  DWDRWH 

IF ( DRWMI N.LE.O) DRWMI N  -  1 

DRWMAX  -  IPROW1  +  DWDRWH  -  MOD(MDRTST, 2 ) 

DCLMIN  -  IPCOLI  -  DWDCLH 
IF(DCLMIN.LF..O)DCLMIN  -  I 


DCLMAX  -  IPC0L1  +  DWDCLH  -  MOD(MDCTST, 2 ) 

***  INPUT  INTERESTING  POINTS  FROM  IMACE  TWO  *** 

DO  10  K=1 , IPKNT2 
DRW FLO  -  0 
DCLFLG  -  0 

READ(LUN2 , 3 ,  ERR-200)  IPR0W2  ,  IPC0L2  ,  X2  ,  ( IPCW2( 12  ) ,  12-1  , CWSZF2  ) 
F0RMAT(2I3, F10. 3,<CWSZE2>I3 ) 

***  TEST  FOR  POINTS  WITHIN  DISPARITY  WINDOW  *** 

IF(IPROt'T2.CE.DRWMIM.AMD.IPROW2.LE.nRW*AX)  DRWFLC  =  1 
IF ( I POO L2 . OE . DCLM IN . AND . I PC0L2 . LE . DCLMAX )  DCLFLG  *  1 
IF(DRWFLG.EQ.O.OR.DCLFLG.EO.O)GO  TO  10 
1  =  1+2 

LBLKNT  =  LBLKNT  +  l 
W3KNT  =  W8KNT  +  1 

***  DETERMINE  WEIGHT  VALUE  FOP.  EACH  CANDIDATE  MATCH  POINT  *** 
CALL  OJDEQ8  (  Cl  TEST ,  CVJSZ  E  ) 

CALL  W8AFND(V8ANBP.,CWSZE,C,W,I1MP1  ,ITMP2  ,IROW) 

IF(CWTEST.EQ.O)GO  TO  4 
BACKSPACE  LUN1 

READ(LUN1 , 1 ,ERR=100)  IPR0W1 , IPC0L1 , XI , (IPCW1 (II ) ,11=1 , CWSZ El ) 

***  ASSIGN  LABELS  TO  EACH  CANDIDATE  POINT  *** 

LX  =  I PROW 1  -  I PROW 2 
LY  »  IPC0L1  -  IPC0L2 
WRITE  (6,*)  '  ' 

WRITE  (6,*)  'IPR0W1  =  ' , IPROW 1 , '  IPR0W2  =  ' , IPR0W2 , '  LX  =  \LX 
WRITE  (6,*)  'IPC0L1  =  ' , IPC0L1 , '  IPC0L2  =  '.IPC0L2,'  LY  =  ' ,LY 

***  STORE  LABELS  *** 

STORE(I.J)  =  LX 
ST0RE(I+1 , J)  =  LY 

***  STORE  WEIGHTS  *** 

ST0RE( W8KNT, J )  =  W 

***  TEST  FOR  EXCESS  OF  STORAGE  LIMIT  *** 

IF(I+1.CE.LBLTST)C0  TO  30 
CONTINUE 
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C  ***  TEST  FOR  NO  LABELS  *** 

C 

14  IF(LBLKNT.NE.O)GO  TO  15 
STORE(W8KNT+l  ,  J)  -  0 
LBLKNT  -  1 

C 

C  ***  STORE  NUMBER  OF  LABELS  *** 

C 

15  STORE (3,J)  -  LBLKNT 
C 

1 A  REMIND  LUN2 

20  CONTINUE 

RETURN 

30  TYPE  ' 

TYPE  *,'***  LABEL  STORAGE  SIZE  EXCEEDED  ***' 

TYPE  ' 

WRITE  (6,*)  '  ' 

WRITE  (A,*)  '***  LABEL  STORAGE  SIZE  EXCEEDED  ***' 

WRITE  (6,*)  '  ' 

WRITE  (6,*)  'LABEL  STORAGE  EXCEEDED  AT:' 

WRITE  (6,*)  '  ' 

WR ITE  (6,*)  '  IP  NUMBER  (SET  1)  -  ',J 
WRITE  (6,*)  5*1?  ROW  -  '  ,  IPROW 1 

WRITE  (6,*)  '  <?IP  COL  -  ' , IPC0L1 

WRITE  (6,*)  '  ' 

WRITE  (6,*)  '  IP  NUMBER  (SET  2)  -  ',K 
WRITE  (6,*)  '  (IIP  ROW  -  ' ,  IPR0W2 

WRITE  (6,*)  '  (IIP  COL  *  ' ,  IPC0L2 

WRITE  (6,*)  '  ' 

DRWMIN  »  DF.WMIN  +  1 

DRWMAX  -  DRWMAX  -  1 

DCLMIN  -  DCLMIN  +  1 

DCLMAX  -  DCLMAX  -  1 

DRVJNEW  -  2* (DRWMAX  +  M0D(MDRTST,2 )  -  IPROW  1  +  1) 

DCLNEW  »  2* (DCLMAX  +  MOD(MDCTST, 2 )  -  IPC0L1  +  1) 

IF( (DRWMIN+1 ) .GE. DRWMAX. OR. (DCLMIN+1 ) . GE.DCLMAX)GO  TO  14 
WRITE  (6,*)  '***  RETRYING  WITH  NEW  DISPARITY  WINDOW  ***' 

WRITE  (6,*)  '  ' 

WRITE  (6,*)  '  NUMBER  OF  DISPARITY  WINDOW  ROWS  *  ' , DRWMEW 

WRITE  (6,*)  '  NUMBER  OF  DISPARITY  WINDOW  COLUMNS  -  ' , DCLNEW’ 

WRITE  (A,*)  '  ' 

REWIND  LUN2 

READ( LITN2 , 2  ,  ERR-2  00  )  I PKNT2 ,  IA ,  IB ,  IC ,  CWSZE2 
W8KNT  -  LBLTST 
LBLKNT  -  0 
1-2 
GO  TO  5 

100  TYPE  ' 

TYPE  *,'***  READ  ERROR  OCCURED  IN  LABELS  ON  LOGICAL  UNIT'.LUNl, 
1'  ***' 
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CL0SE(UNIT-LUN1 ,  DISPOSE- 'KEEP '  ) 

CLOSE(UNIT-LUN2  ,  DISPOSE-'KEEP '  ) 

LABERR  -  1 

WRITE  (A,*)  '***  EXIT  LARELS  -  READ  ERROR  TERMINATION  ***' 
RETURN 

200  TYPE  ' 

TYPE  *,'***  READ  ERROR  OCCURED  IN  LABELS  ON  LOGICAL  UNIT', LUN2, 
1*  ***' 

CL0SE(UNIT-LUN1  , DISPOSE- 'KEEP ' ) 

CL0SE(UNIT-LUN2 , DISPOSE- 'KEEP ' ) 

LABERR  -  1 

WRITE  (6,*)  '***  EXIT  LABELS  -  READ  ERROR  TERMINATION  ***' 

RETURN 

END 
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SUBROUTINE  CUDE08(CWTEST,K) 


C 

C  THIS  SUBROUTINE  FINDS  THE  INTERSECTION  OF  THE  CORRELATION 

C  WINDOWS  BASED  ON  THE  ORIENTATION  DETERMINED  IN  SUBROUTINE 

C  CWCOMP.  THE  COMMON  ELEMENTS  OF  EACH  WINDOW  ARE  THEN  RESTORED 

C  IN  THEIR  RESPECTIVE  ARRAYS  BEGINNING  IN  COLUMN  ONE.  THE 

C  VALUE  OF  K  RETURNED  IS  THE  COMMON  CORRELATION  WINDOW  SIZE. 

C 

INCLUDE  'COMMON. FTN' 

COMMON  /REG1/  IPCWl(M/3),IPCW2(M/3) 

COMMON  /REC2 /  ITMP1 (M/3) , ITMP2 (M/3) 

COMMON  /IPSI/  1X1 , IY1  ,CWROWl  .CWCOLl  .CWSZF.l 
COMMON  /I?S2/  1X2 , IY2 , CWROW2 , CWCOL2 , CWSZE2 
INTEGER  CVROW1 , CWCOLl  .CWSZEl  ,CWROW2  .CWCOL2  .CWSZE2 , CWTEST 
D  WRITE  (6,*)  '***  ENTER  CWDEQ8  ***' 

K  -  0 

IF(CWTEST.NE.O)GO  TO  5 

***  CASE  0:  CWROW1  -  CWROW2  AND  CWCOLl  *  CWCOL2  *** 

K  -  CWSZF.l 
ISZF.  -  CWCOLl 
GO  TO  100 
RETURN 

GO  TO(  10, 2 0,30, 40, 50, 60, 70, 80 )C' '/TEST 

***  CASE  1:  CWR0W1  >  CJRW2  AND  CWCOLl  >  CWC0L2  *** 

11  IRWDIF  -  CVR0W1  -  CWR0W2 

IRWDFH  -  IRWDIF/2 
ICLDIF  -  CWCOLl  -  CWC0L2 
ICLDFH  -  ICLDIF/2 

DO  15  I-IRWDFH+1 ,CWROWI-IRWDFH-MOD(IRWDIF ,? ) 

DO  15  J-ICLDFH+1 ,CWC0L1-ICLDFH-M0D(ICLDIF ,2) 

K  -  K  +  1 

ITMPl(K)  -  IPCW1((I-1 )*CWC0L1+J) 

5  CONTINUE 

DO  16  1-1, K 
IPCWl(I)  -  ITMP1 (I) 

6  CONTINUE 
ISZE  -  CWC0L2 
GO  TO  100 
RETURN 

***  CASE  2:  CVR0W1  <  CWR0W2  AND  CWCOLl  <  CWC0L2  *** 

20  IRWDIF  -  CWR0W2  -  CWR0W1 

IRWDFH  -  IRWDIF/2 
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ICLDIF  -  CWC0L2  -  CWCOLl 
ICLDFH  -  ICLDIF/2 

DO  25  I-IRWDFH+1 ,CWR0W2-IRWDFH-M0D(IRWDIF,2) 

DO  25  J-ICLDFH+1 ,CWCOL2-ICLDFH-MOD(ICLDIF, 2) 

K  -  K  +  1 

ITMP2(K)  -  IPCW2((I-1)*CWC0L2+J) 

25  CONTINUE 

DO  26  I-l,’< 

IPCW2 ( I )  -  ITT1P2(I) 

26  CONTINUE 

D  ISZE  -  CWCOLl 

D  GO  TO  100 

RETURN 
C 

C  ***  CASE  3:  CWROU1  >  CWROW2  AMD  CWCOLl  <  CWCOL2  *** 

C 

30  IRWDIF  =  CNROWl  -  CWROW2 

IRWDFIl  -  IRWDIF/ 2 
ICLDIF  -  CNCOL2  -  CWCOL1 
ICLDFH  -  ICLDIF/2 
DO  35  I-1.CWROW2 

DO  35  J-ICLDFH+l,CWCOL2-ICLDFH-MOD(ICLDIt ,2) 

K  -  K  +  1 

ITMP1 (K)  -  IPCW1 (IRWDFH*CWC0L1+K) 

ITMP2 (K)  -  IPCW2 ( ( 1-1 ) *CWCOL2+J ) 

35  CONTINUE 

DO  36  I-1,K 
IPCWl(I)  -  ITMPl(I) 

IPCW2(I)  -  ITMP2(I) 

36  CONTINUE 

D  ISZE  -  CWCOL1 

D  GO  TO  100 

RETURN 
C 

C  ***  CASE  4:  CWROW1  <  CWR0W2  AND  CWCOL1  >  CWCOL2  *** 

C 

40  IRWDIF  -  CWR0W2  -  CWR0W1 

IRWDFH  -  IRWDIF/ 2 
ICLDIF  -  CWCOLl  -  CWC0L2 
ICLDFH  -  ICLDIF/2 
DO  45  I-1.CWRCW1 

DO  45  J-ICLDFH+1 , CWCOLl- ICLDFH-MOD(ICLDIF, 2) 

K  -  K  +  1 

ITMPl(K)  -  IPCW1((I-1)*CWC0L1+J) 

ITMPI(K)  -  IPCW2 (IRWDFH*CWC0L2+K) 

45  CONTINUE 

DO  46  I-l,K 
IPCWl(I)  -  ITMPl(I) 

IPCW2 ( I )  -  ITMP2(I) 

46  CONTINUE 
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D  ISZE  -  CWC0L2 

0  GO  TO  100 

RETURN 
C 

C  ***  CASE  5:  CWR0W1  -  CWR0U2  AND  CWC0L1  >  CWC0L2  *** 

C 

50  ICLDIF  -  CWC0L1  -  CWC0L2 

ICLDFH  -  ICLDIF/2 
DO  55  I-l.CWROWl 

DO  55  J-ICLDFH+1,CWC0L1-ICLDFH-M0D(ICLDIF,2) 

X  -  X  +  1 

ITMPl(K)  -  IPCW1((I-1)*CUC0L1+J) 

55  CONTINUE 

DO  56  I-l.X 
IPCWl(I)  -  ITMPl(I) 

56  CONTINUE 

D  ISZE  -  CWC0L2 

D  GO  TO  100 

RETURN 
C 


c 

n 

***  CASE  6:  CUR0W1  -  CV R0W2  AND  CWC0L1  < 

CWC0L2  *** 

60 

ICLDIF  -  CWC0L2  -  CWC0L1 

ICLDFH  -  ICLDIF/2 

DO  65  I-l.CWROWl 

DO  65  J«ICLDFU+l,CWC0L2-lCLDFH-M0D( ICLDIF 

,2) 

65 

K  -  K  +  1 

IIMP2 (X)  -  I PCW2 ( ( I - l ) *CWCO L2+J ) 

CONTINUE 

66 

DO  66  I-l.X 

IPCW2 ( I )  -  ITMP2 (I) 

CONTINUE 

D 

ISZE  -  CWC0L1 

D 

GO  TO  100 

C 

C 

n 

RETURN 

***  CASE  7:  CWR0W1  >  CWR0W2  AND  CWC0L1  - 

CWC0L2  *** 

Vj 

70 

IRWDIF  -  CWROWl  -  CWR0W2 

IRWDFH  -  IRWDIF/2 

DO  75  I-IRWDFH+1 ,CUR0W1-IRWDFH-M0D(IRWDIF 

,2) 

75 

DO  75  J-l.CWCOLl 

X  -  X  +  1 

ITMPl(K)  -  IPCW1 (IRWDFH*CWC0L1+K) 

CONTINUE 

76 

DO  76  I-l.X 

IPCWl(I)  -  ITMPl(I) 

CONTINUE 

D 

ISZE  -  CWC0L1 

D 

GO  TO  100 
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RETURN' 


***  CASE  8:  CUR 0W1  <  CWROW2  AND  CWCOL1  -  CWCOL2 

IRUDIF  -  CWROW2  -  CWROW1 
IRWDFH  »  IRWDIF/2 

DO  35  I-IRWDFH+1 ,CWROW2-IRWDFH-MOD(IRWDIF,2) 

DO  85  J-l.CWCOLl 
K  »  K  +  1 

ITMP2(K)  -  IFCK2 ( I RWDFH*CWCOL 1+K ) 

CONTINUE 

DO  36  I«1,K 

IPCW2 ( I )  -  ITMP2 (I ) 

CONTINUE 
ISZE  -  CWCOL1 
WRITE  (6,*)  *  ' 

WRITE  (6,*)  'NEW  CORRELATION  WINDOW  1:' 

WRITE  (6,*)  ' - ' 

WRITE  (6, 101 ) (IPCW1 (I) , I"l ,K) 

FORMAT( <ISZE>( 2  X , 13 ) ) 

WRITE  (6,*)  '  ' 

WRITE  (6,*)  'NEW  CORRELATION  WINDOW  2:' 

WRITE  (6,*)  ' - ' 

WRITE  (6,101)(IPCW2(I),I-1,K) 

WRITE  (6,*)  '  ' 

RETURN 


noon 


SUBROUTINE  W8AFND(W8ANBR, CWSZE, C ,W, ITMP1 , ITMP2 , IRON) 

THIS  SUBROUTINE  PASSES  CONTROL  TO  THE  WEIGHT  ALGORITHM  SELECTED 
BY  THE  USER  IN  SUBROUTINE  W8ASEL.  THE  CORRESPONDING  COMPUTED 
WIGHT  IS  RETURNED. 

C 

INTEGER  W8ANBR, CWSZE 
GO  TO( 10,20, 30,40, 50, 60)W8ANBR 
10  CALL  W8ALG1 (CWSZE, C,W) 

RETURN 

20  CALL  W8ALG2 (CWSZE, C.W) 

RETURN 

30  CALL  W8ALG3 (CWSZE , C , W) 

RETURN 

40  CALL  W8ALG4( CWSZE, C,W, ITMPi ,ITMP2 , IROW) 

RETURN 

50  CALL  W8ALG5 (CWSZE, C.W) 

RETURN 

60  CALL  W8ALG6( CWSZE, W) 

RETURN 

END 
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SUBROUTINE  W8ALG1 ( CWSZE, C,W) 


C 

C  THIS  SUBROUTINE  FORMS  THE  SUM  OF  THE  SQUARES  OF  THE  DIFFERENCES 

C  OF  THE  PIXELS  OF  THE  CORRELATION  WINDOWS  TO  BE  COMPARED.  A 

C  WEIGHT  FOR  THE  MATCHING  ALGORITHM  IS  THEN  COMPUTED  FROM  THIS 

C  SUM  ’(ULTIPLIED  BY  AN  ARBITRARY  CONSTANT. 

C 

INCLUDE  'COMMON. FTN' 

COMMON  /REGI/  IPCWl(M/3), IPCW2(M/3) 

INTEGER  CWSZE 

D  WRITE  (6,*)  ’***  ENTER  W8ALG1  ***’ 

SUM  -  0 

***  FORM  SUM  OF  SQUARES  OF  PIXEL  DIFFERENCES  *** 

DO  10  I-i, CWSZE 

OrNDIF  -  IPCWl(I)  -  IPCW2(I ) 

DIFSQR  -  CWNDIF*CUNDIF 
SUM  -  SUM  +  DIFSQR 
0  CONTINUE 

***  COMPUTE  WEIGHT  FOR  MATCHING  ALGORITHM  *** 

W  -  l.O/d.O  +  C*SUM) 

WRITE  (6,*)  'W8ALG1  WEIGHT  -  ',W 

RETURN 

END 
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SUBROUTINE  W8ALG2 (CWSZE.C.W) 


C 

C  THIS  SUBROUTINE  FORMS  THE  AVERAGE  OF  THE  ELEMENTS  OF  THE  COR- 

C  RELATION  WINDOWS  TO  BE  COMPARED.  THE  ABSOLUTE  VALUE  OF  THE 

C  DIFFERENCE  OF  THESE  AVERAGES  IS  THEN  USED  TO  COMPUTE  A  WEIGHT 

C  FOR  THE  MATCHING  ALGORITHM. 

C 

INCLUDE  ' COMMON. FTN ' 

COMMON  /REGl /  IPCW1 (M/3) , IPCW2 (M/3) 

INTEGER  CWSZK 

D  WRITE  (6,*)  '***  ENTER  W8ALG2  ***' 

SUM1  -  0 

SUM2  =  0 

***  FORM  SUMS  OF  PIXELS  OF  EACH  WINDOW  *** 

DO  10  I-l.CWSZE 
SUM1  -  SUMl  +  IPCWl(I) 

SUM2  -  SUM2  +  IPCW2(I) 

0  CONTINUE 

***  FORM  WINDOW  AVERAGES  *** 

CWAVE1  -  SUM1/CWSZE 
CWAVE2  -  SUM2/CWSZE 

***  FORM  ABSOLUTE  VALUE  OF  AVERAGE  DIFFERENCE  *** 

CWNDIF  -  ABS(CWAVE1  -  CWAVE2) 

***  COMPUTE  WEIGHT  FOR  MATCHING  ALGORITHM  *** 

W  -  1.0/ (1.0  +  C*CWNDIF) 

WRITE  (6,*)  'W8ALG2  WEIGHT  -  ',W 

RETURN 

END 
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SUBROUTINE  W8ALG3 (CWSZE , C , W) 


C 

C  THIS  SUBROUTINE  FORMS  THE  C F.NTER-MI NUS -AVE RAGE  OF  THE  ELEMENTS 

C  OF  THE  CORRELATION  WINDOWS  TO  BE  COMPARED.  THE  ABSOLUTE  VALUE 

C  OF  THE  DIFFERENCE  OF  THESE  AVERAGES  IS  THEN  USED  TO  COMPUTE  A 

C  WEIGHT  FOR  THE  MATCHING  ALGORITHM. 

C 

INCLUDE  'COMMON. FTN' 

COMMON  /REG1 /  IPCW1 (M/ 3 ) , IPCW2(M/3) 

INTEGER  CWSZE 

D  WRITE  (6,*)  '***  ENTER  W8ALG3  ***’ 

SUM1  =  0 

SUM2  -  0 

ICNTR  -  CWSZE/2  +  1 

***  FORM  SUMS  OF  PIXELS  OF  EACH  WINDOW  *** 

DO  10  1*1 , CWSZE 
SUM1  -  SUM 1  +  IPCWl(I) 

SUM2  -  SUM2  +  IPCW2(I) 

3  CONTINUE 

***  FORM  WINDOW  AVERACES  *** 

CWAVE1  -  SU>tl /CWSZE 
CWAVE2  -  SUM2 /CWSZE 

***  FORM  CENTER-MINUS-AVERAGES  *** 

CMAVE1  -  IPCW1 (ICNTR)  -  CWAVE1 
CMAVE2  -  IPCW2( ICNTR)  -  C WAVE 2 

***  FORM  ABSOLUTE  VALUE  OF  AVERAGE  DIFFERENCE  *** 

CWNDIF  -  ABS(CMAVE1  -  CMAVE2 ) 

***  COMPUTE  WEIGHT  FOR  MATCHING  ALGORITHM  *** 

W  -  1.0/(1.0  +  C*CWNDIF) 

WRITE  (6,*)  'W8ALG3  WEIGHT  -  ',W 

RETURN 

END 
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SUBROUTINE  W8ALG4 ( ISZE , C , W , ITMP 1 ,ITMP2,K) 

C 

C  THIS  SUBROUTINE  FORMS  THE  GRADIENT  OF  THE  ELEMENTS  OF  THE  COR 

C  RELATION  WINDOWS  TO  3E  COMPARED.  THE  ABSOLUTE  VALUE  OF  THE 

C  DIFFERENCE  OF  THESE  GRADIENTS  IS  THEN  USED  TO  COMPUTE  A  WEIGH 

C  FOR  THE  MATCHING  ALGORITHM. 

C 

INCLUDE  ' COMMON. FTN' 

COMMON  /REG1/  IPCW1 (M/3 ) , IPCW2(M/3) 

DIMENSION  ITMP1  (K,K) ,  ITMP2  (K,K) 

D  WRITE  (6,*)  '***  ENTER  MALM  ***' 

***  DETERMINE  NEW  WINDOW  SIZE  (SQUARE)  *** 

CWSZE  -  ISZE 
CWSQRT  =  SQRT(CWSZE) 

I SORT  -  CWSQRT 
ISQRTH  -  ISQRT/2 
ISQR  =  ISQRT*ISORT 
I DIF  -  CWSZE  -  ISQR 
IF(IDIF.NE.O)GO  TO  1 
KOUNT  -  1 
GO  TO  5 

KOUNT  -  (IDIF-1 )/2  +  2 

***  FORM  NTO  WINDOWS  *** 

DO  10  1*1 , ISORT 
DO  10  J-l.ISQRT 
ITMP1 (I, J)  -  IPCW1 (KOUNT) 

ITMP2(I , J)  -  IPCW2 (KOUNT) 

KOUNT  -  KOUNT  +  1 
10  CONTINUE 

D  WRITE  (6,*)  '  ' 

D  WRITE  (6,*)  'NEW  CORRELATION  WINDOW  1  (W8ALG4): ' 

D  WRITE  (6,*)  ' - ' 

D  WRITE  (6,11)  ( (ITMP1( I, J), J-l , ISORT), 1*1, ISORT) 

Dll  F0RMAT(<ISQRT>(2X, 13) ) 

D  WRITE  (6,*)  '  ' 

D  WRITE  (6,*)  'NEW  CORRELATION  WINDOW  2  (W8ALG4 ) : ' 

D  WRITE  (6,*)  ' - ' 

D  WRITE  (6,11)  ( (ITMP2(I, J) , J*1 , ISORT) , 1*1 , ISQRT) 

D  WRITE  (6,*)  '  ' 

C 

C  ***  FORM  SUMS  OF  UPPER  LEFT  OUARTER  OF  WINDOWS  *** 

C 

KOUNT  -  0 
ASUMl  -  0 
ASUM2  -  0 
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00  20  1*1 ,  ISORTH+MOD(ISORT, 2  ) 

DO  20  J>*1 ,  ISORTH+M0D(ISQRT, 2  ) 

ASUM1  -  ASUMl  +  ITMPl(I.J) 

ASUM2  -  A RUM 2  +  ITMP2(I,J) 

K01JNT  -  KOUNT  +  1 
20  CONTINUE 

C 

C  ***  FORM  SUMS  OF  UPPER  RIGHT  QUAPTER  OF  WINDOWS  *** 

C 

BSIJM.l  -  0 

BSUM2  *  0 

no  30  1*1 ,ISQRTH4M0n(ISQRT,2) 

DO  30  J*ISORTH+MOD(ISORT,2  ),  ISQRT 
BSUM1  *  BSUM1  +  ITMPl(I.J) 

BSUM2  -  BSUM2  +  ITMP2(I,J) 

30  COMTINUE 

C 

C  ***  FORM  SUMS  OF  LOWER  LEFT  QUARTER  OF  WINDOWS  *** 

C 

CSUM1  =  0 

CSUM2  =»  0 

DO  40  I*  I  SORTH+MO  D(  I SQRT ,  2  )  ,  I SQRT 
DO  40  J=l,tS0RTH+M0D(ISQRT,2) 

CSUM1  -  CSUM1  +  ITMP1  (I ,  J) 

CSUM2  -  CRUM2  +  ITMP2(I,J) 

40  CONTINUE 

C 

C  ***  FORM  SUMS  OF  LOWER  RIGHT  QUARTER  OF  WINDOWS  *** 

C 

DSUM1  -  0 
DSUM2  -  0 

DO  50  I-IS0RTH4M0D( ISQRT, 2), ISQRT 
DO  50  J*ISQRTH-tf!OD( ISQRT, 2),  ISQRT 
DSUM1  -  DSUM1  +  ITMPl(l.J) 

DSUM2  -  DSUM2  +  ITMP2(I,J) 

50  CONTINUE 

C 

C  ***  FORM  QUADRANT  AVERAGES  *** 

C 

A1  -  ASUM1 /KOUNT 
B1  -  BSUM1 /KOUNT 
Cl  -  CSUM1  /KOIJNT 
D1  -  DSUM1 /KOUNT 
C 

A2  -  ASUM2 /KOUNT 
82  -  BSUM2 /KOUNT 
C2  -  CSUM2 /KOUNT 
D2  -  DSUM2/K0U.W 
C 

C  ***  F ORN  COORDINATE  DIFFERENCES  *** 
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C 

NDF  -  (ISQRT+1  )/2 
ALPHAl  -  ( (Al+B 1 )  -  (Cl+Dl ) )/NDF 
BETA1  -  (  (Bl+Dl  )  -  (Al+C  1 ) )/NDF 
C 

ALPHA2  -  ( (A2+B2 )  -  (C2+D2))/NDF 
BETA2  =  ((B2+D2)  -  (A2+C2))/NDF 

***  FORM  CRADIEN’T  MAGNITUDES  *** 

G1  -  S0RT(AL?HA1*ALPHA1  +  BETA 1*B ETA 1 ) 

G2  -  SQRT(AL?HA2*ALPHA2  +  BETA2*3ETA2 ) 

***  FORM  GRADIENT  DIFFERENCE  *** 

CWNDIF  *  ABS(C1  -  G2 ) 

***  FORM  WEIGHT  FOR  MATCHING  ALGORITHM  *** 

W  -  I. 0/(1 .0  +  C*CWNDIF) 

WRITE  (6,*)  'W8\L04  WEIGHT  -  ' ,W 
RETURN 
END 
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SUBROUT  INK  W8AI.G5  ( CWSZE ,  C ,  W) 

C 

C  THIS  SUBROUTINE  FORMS  THE  VARIANCE  OF  THE  ELEMENTS  OF  THE  COR- 

C  RELATION  WINDOWS  TO  BE  COMPARED.  THE  ABSOLUTE  VALUE  OF  THE 

C  DIFFERENCE  OF  THESE  VARIANCES  IS  THEN  USED  TO  COMPUTE  A  WEIGHT 

FOR  THE  MATCHING  ALGORITHM. 

INCLUDE  'COMMON. FTN' 

COMMON  /REC1 /  IPCWl(M/3) , IPCW2(M/3) 

INTEGER  CWSZE 

WRITE  (6,*)  '***  ENTER  W8ALG5  ***' 

SUM1  =  0 
SUM2  =  0 
SORSM1  -  0 
SQRSM2  =  0 

***  FORM  SQUARES  AND  SUMS  OF  PIXELS  OF  EACH  WINDOW  *** 

DO  10  I- 1, CWSZE 
FLTIC1  =  FLOAT(IPCWKI)) 

SQRIC1  -  FLTIC I*FLTIC 1 
SORSMI  -  SQRSM1  +  SQRICI 
FLTIC  2  =■  FLOAT(IPCW2(I)) 

SORIC2  =  FLTIC2*FLTIC2 
SQRSM2  -  SQRSM2  +  SORIC2 
SUM I  -  SUM1  +  IPCWI(I) 

SUM2  -  SUM2  +  IPCW2(I ) 

0  CONTINUE 

***  FORM  WINDOW  MEANS  *** 

CMEAN1  -  SUM 1/ CWSZE 
CMEAN2  -  SUM2 /CWSZE 

***  FORM  MEAN  SQUARES  *** 

SQRCM1  -  CME AN  1  *CMEAN  1 
SQRCM2  -  CMEAN2  *CME AN2 

***  FORM  VARIANCES  *** 

CWVARI  -  SQRSM I/CWSZE  -  SQRCMl 
CWVAR2  «  SORSM2/CWSZE  -  SQRCM2 

***  FORM  ABSOLUTE  VALUE  OF  VARIANCE  DIFFERENCE  *** 

CVRD  IF  -  ABS(CVVARi  -  CWVAR2 ) 

C 

C  ***  COMPUTE  WEIGHT  FOR  MATCHING  ALGORITHM  *** 
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W  -  l. 0/(1.0  +  C*CVRDIF) 

WRITE  (6,*)  'W3ALC5  l/EIGHT  -  ',U 
RETURN 
END 


SUBROUTINE  W8ALG6 ( CVS ZE , W) 


THIS  SUBROUTINE  FORMS  THE  STATISTICAL  CORRELATION  OF  THF.  ELEMENTS 
OF  THE  CORRELATION  WINDOWS  TO  BE  COMPARED.  THE  ABSOLUTE  VALUE  OF 
THE  RESULT  IS  A  NUMRER  BETWEEN  0  AND  1.  THIS  NUMBER  IS  USED  AS  THE 
WEIGHT  FOR  THE  MATCHING  ALGORITHM. 


INCLUDE  'COMMON. FTN' 

COMMON  /REG1/  IPCWl(M/3) ,IPCW2(M/3) 

INTEGER  CWSZE 

WRITE  (6,*)  '***  ENTER  W8ALG6  ***' 

SUM I  -  0 

SUM2  -  0 

SPRSM1  =■  0 
SORSM2  ■  0 
CPSUM  »  0 

***  FORM  SQUARES  OF  PIXELS  OF  EACH  WINDOW  *** 

DO  10  I-i.CWSZE 
FLTICI  -  FLOAT(IPCWKI)) 

SQRICI  -  FLTIC I*FLTIC 1 
S0RSM1  -  S0RSM1  +  SORICl 

FLTIC2  -  FL0AT(IPCW2(I)) 

SQRIC2  -  FLTIC2*FLTIC2 
S0RSM2  -  S0RSM2  +  S0RIC2 

***  FORM  SUMS  OF  ELEMENTS  OF  EACH  WINDOW  *** 

SUM1  -  SUM1  +  IPCWl(I) 

SUM2  -  SUM2  +  IPCW2(I) 

***  FORM  CROSS  PRODUCT  SUM  FOR  BOTH  WINDOWS  *** 


CRSPRD  -  FLTIC1*FLTIC2 
CPSUM  »  CPSUM  +  CRSPRD 

CONTINUE 

***  FORM  SUM  SQUARES  *** 

S0RCS1  -  SUM1 *SUM1 
S0RCS2  -  SUM2*StrM2 

***  FORM  COVARIANCE  *** 

C12  -  CWSZE*CPSUM  -  SlfMl*SUM2 
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1 

I 

I 


D 

D 

D 


C 

C 

C 


10 

C 

C 

C 


C 

C 

C 

C 

C 

C 

C 

D 

20 

D 

D 

!) 

D 

30 


SUBROUTINE  INPROB(P) 

THIS  SUBROUTINE  COMPUTES  THE  INITIAL  PROBABILITIES  FOR  THE 
MATCHING  ALGORITHM  FROM  THE  WE IGHTS  COMPUTED  AND  STORED  IN 
SUBROUTINE  LABELS. 

INCLUDE  ' COMMON. FTN' 

VIRTUAL  P(N,M) 

COMMON  /IPS1/  IPKNT1 

WRITE  (6,*)  '***  ENTER  INPROB  ***' 

MINROW  -  (2*(N-4))/3  +  4 
DO  30  J«*l ,  IPKNT1 
WRITE  (A,*)  '  ' 

WRITE  (A,*)  'INITIAL  LABEL  PROBABILITIES:' 

WRITE  (A,*)  ' - ' 

WSUM  -  0 

WMAX  -  P(MINROW,J) 

MAXROW  -  MINROW  +  P(3,J)  -  1 

***  DETERMINE  SUM  OF  WE  IGHTS  AND  MAXIMUM  WEIGHT  *** 

DO  10  I -MINROW, MAXROW 
IF(P(I,J).GT. WMAX )WMAX  -  P(I,J) 

WSUM  -  WSUM  +  P(I,J) 

CONTINUE 

***  DETERMINE  NO  MATCH  PROBABILITY  *** 

P(N, J)  -  1.0  -  WMAX 
IF ( WSUM . EQ . 0 )WSUM  -  1 
DO  20  I -MINROW, MAXROW 

***  DETERMINE  CONDITIONAL  PROBABILITY  *** 

CPROB  -  P( I , J) /WSUM 

***  DETERMINE  INITIAL  PROBABILITIES  *** 

P(I,J)  -  CPROB* ( 1.0  -  P(N, J) ) 

WRITE  (6,*)  'P(',I,',',J,')  -  ',P(I,J) 

CONTINUE 
1/RITE  (6,*)  '  ' 

WRITE  (6,*)  'INITIAL  NO-MATCH  PROBABILITY:' 

WRITE  (A,*)  ' - ' 

WRITE  (A,*)  'P(',N,  V,J,')  -  '  ,P(N,  J) 

CONTINUE 

RETURN- 

END 


336 


non  non  non 


SUBROUTINE  NGHSZE 


C 

C  THIS  SUBROUTINE  ALLOWS  THE  USER  TO  DETERMINE  THE  NUMBER  OF 

C  ROWS  AND  COLUMNS  OF  THE  NEIGHBORHOOD  TO  BE  USED  TO  CHECK 

C  THE  LABELS  FOR  THE  MATCHING  ALGORITHM.  THE  USER  IS  ASKED  TO 

C  CHECK  THE  INPUT  INFORMATION  AND  MAKE  CORRECTIONS  IF  NECESSARY. 

C 

COMMON  /NBHOOD/  NGHROW , NGHCOL , NCHRWH , NGHCLH , NGSZE , NGHINV 
INTEGER  NCHROW, NGHCOL, NGHRWH, NGHCLH, NGSZE 
REAL  NGHINV 
TYPE  *, '  ' 

TYPE  *, 'PLEASE  TYPE  THE  NUMBER  OF  ROWS  AND  COLUMNS' 

TYPE  *, 'OF  THE  NEIGHBORHOOD:' 

TYPE  *,'  ' 

***  ENTER  THE  NUMBER  OF  ROWS  AND  COLUMNS  OF  THE  NEIGHBORHOOD  *** 
CALL  NRCFND 

***COMPUTE  THE  NEIGHBORHOOD (NUMBER  OF  ROUS  X  NUMBER  OF  COLUMNS)*** 

NGSZE  -  NGHROW*NGHCOI. 

NGHRWH  -  NCHROW/ 2 
NGHCLH  -  NGHCOL/2 

***  COMPUTE  THE  INVERSE  OF  THE  NEIGHBORHOOD  *** 

NGHINV  -  I.O/NGSZE 
C 

WRITE  (6,*)  '  ' 

WRITE  (6,*)  '***  NEIGHBORHOOD  INFORMATION  ***' 

WRITE  (6,*)  '  ' 

WRITE  (6,*)  'NUMBER  OF  NEIGHBORHOOD  ROWS  -  ' , NGHROW 
WRITE  (6,*)  ' NUMBER  OF  NEIGHBORHOOD  COLUMNS  -  '.NGHCOL 
WRITE  (6,*)  'NEIGHBORHOOD  SIZE  (ROWSXCOLUMNS)  -  ', NGSZE 
WRITE  (6,*)  'INVERSE  OF  NEIGHBORHOOD  SIZE  -  '.NGHINV 
WRITE  (6,*)  '  ' 

RETURN 

END 
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SUBROUTINE  NRCFND 


C 

C  THIS  SUBROUTINE  ALLOWS  THE  USER  TO  ENTER  THE  NUMBER  OF  ROWS  AND 

C  COLUMNS  INTERACTIVELY  FOR  THE  NEIGHBORHOOD  TO  BE  USED  TO  CHECK 

C  THE  LABELS  FOR  THE  MATCHING  ALGORITHM.  THE  USER  MAY  CORRECT  THIS 

C  INFORMATION  IF  AN  ENTRY  ERROR  OCCURS. 

C 

C  ***  ENTER  THE  NUMBER  OF  ROWS  AND  COLUMNS  *** 

C 

CALL  NGROW 
CALL  NGCOL 

***  OPTIONAL  ENTRY  INFORMATION  CHECK  *** 

TYPE  *,'  ' 

TYPE  *,'DO  YOU  WISH  TO  CHECK  FOR  ENTRY  ERRORS?' 

TYPE  ' IF  YOU  DO,  TYPE  YES.  OTHERWISE,  TYPE  NO.' 

TYPE  *,'  ' 

TYPE  1 

FORMAT(5X, 'ANSWER  =  ',$) 

ACCEPT  2 .ANSWER 
F0RI1AT(A3) 

***  CHECK  ANSWER  ENTRY  *** 

CALL  ANSCHK( ANSWER) 

IF(ANSWER.EQ.'NO')GO  TO  3 

***  CHECK  ENTRY  INFORMATION  *** 

CALL  MRCCHK 
C 

3  RETURN 

END 
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SUBROUTINE  NRCCHK 


C 

C  THIS  SUBROUTINE  ALLOWS  THE  USER  TO  CHECK  THE  INFORMATION 

C  INPUT  FOR  THE  NUMBER  OF  ROWS  AND  COLUMNS  OF  THE  HEIGHBOR- 

C  HOOD,  AND  TO  CORRECT  THEM  IF  DESIRED. 

C 

COMMON  /NBHOOD/  NCHROW , NCHCOL 
INTEGER  NGHROW, NCHCOL 
1  TYPE  ' 

TYPE  *, 'HERE  IS  WHAT  YOU  HAVE  INPUT:' 

TYPE  ' 

***  DISPLAY  THE  NUMBER  OF  NEIGHBORHOOD  ROWS  AND  COLUMNS  *** 

TYPE  *, 'NUMBER  OF  NEIGHBORHOOD  ROWS  -  ' , NGHROW 
TYPE  *, 'NUMBER  OF  NEIGHBORHOOD  COLUMNS  »  NCHCOL 

***  VERIFY  THE  CORRECT  RESPONSE  *** 

CALL  VERIFY(ANSUER) 

IF(ANSWER.EQ. 'YES' )GO  TO  2 

***  CHANCE  INCORRECT  INFORMATION  *** 


C 

2 


CALL  NRCCOR 

GO  TO  1 

RETURN 

END 
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SUBROUTINE  NRCCPR 


THIS  SUBROUTINE  ALLOWS  THE  USER  TO  CORRECT  THE  INFORMATION 
INPUT  FOK  THE  NUMBER  OF  NEIGHBORHOOD  ROWS  AND  COLUMNS. 

REAL  ITEM 

***  MAKE  ERROR  CORRECTIONS  *** 

TYPE  ' 

TYPE  *,  'DO  YOU  WANT  TO  CHANGE  THE  NUMBER  OF  ROWS,  COLUMNS,' 

TYPE  *, 'OR  BOTH?' 

TYPE  ' IF  YOU  WANT  TO  CHANGE  THE  NUMBER  OF  ROWS,  TYPE  ROWS.' 

TYPE  *, 'IF  YOU  WANT  TO  CHANGE  THE  NUMBER  OF  COLUMNS,  TYPE  COLS.' 

TYPE  *, ' IF  YOU  WANT  TO  CHANGE  BOTH,  TYPE  BOTH.' 

TYPE  *,'  ' 

TYPE  2 

FORMA?( 5X, ' ITEM  YOU  WISH  TO  CHANGE  -  ',S) 

ACCEPT  3, ITEM 
FORMAT (A4) 

IF(ITEM.EQ. ' BOTH' )GO  TO  10 
IF ( ITEM. EQ. 'ROWS' )GO  TO  20 
IF ( ITEM. EQ.' COLS ' )G0  TO  30 
TYPE  *,'  ' 

TYPE  *,'***  ITEM  ENTRY  ERROR  -  PLEASE  RETYPE  ***' 

TYPE  *,'  ' 

GO  TO  1 

***  CHANCE  BOTH  NUMBER  OF  ROWS  AND  COLUMNS  *** 

CALL  NGROW 
CALL  NGCOL 
RETURN 

***  CHANGE  NUMBER  OF  ROWS  *** 

CALL  NGROW 
RETURN 

***  CHANGE  NUMBER  OF  COLUMNS  *** 

30  CALL  NGCOL 

RETURN 
END 
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SUBROUTINE  KGROW 


THIS  SUBROUTINE  ALLOWS  THE  USER  TO  INPUT  THE  NUMBER  OF  ROWS 
OF  THE  NEIGHBORHOOD. 

INCLUDE  'COMMON. FTN' 

COMMON  /NBHOOD/  NGHROW 

***  ENTER  THE  NUMBER  OF  NEIGHBORHOOD  ROUS  *** 

TYPE  1 

FORMAT(5X, 'NUMBER  OF  NEIGHBORHOOD  ROWS  -  ',$) 

ACCEPT  *, NGHROW 

IF ( NGHROW. CT. M)GO  TO  2 

IF (NGHROW. LT. 2 )GO  TO  3 

RETURN 
TYPE  ' 

TYPE  *,'***  MAXIMUM  NEIGHBORHOOD  ROW  SIZE'.M,'  EXCEEDED  IN  NGROW  ** 

1*' 

GO  TO  4 
TYPE  *,'  ' 

TYPE  *,'***  ROW  SIZE  SMALLER  THAN  2  (MINIMUM)  ATTEMPTED  ***' 

***  CORRECT  ROW  SIZE  *** 

CALL  NRCCOR 

IF ( NGHROW. CT.M)GO  TO  2 
IF ( NCHROW . LT. 2 )GO  TO  3 
RETURN 
END 
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SUBROUTINE  NGCOL 


THIS  SUBROUTINE  ALLOUS  THE  USER  TO  INPUT  THE  NUMBER  OF  COLIR1NS 
OF  THE  NEIGHBORHOOD. 

INCLUDE  'COMMON. FTN' 

COMMON  /NBHOOD/  IX.NGHCOL 

***  ENTER  THE  NUMBER  OF  NEIGHBORHOOD  COLl’MNS  *** 

TYPE  1 

FORMAT(5X, 'NUMBER  OF  NEIGHBORHOOD  COLUMNS  -  ',$) 

ACCEPT  * , NGHCOL 
IF(NCHCOL.OT.M)GO  TO  2 
IF ( NGHCOL.LT. 2 )G0  TO  3 

RETURN 
TYPE  ' 

TYPE  *,'***  MAXIMUM  NEIGHBORHOOD  COLUMN  SIZE',?!,'  EXCEEDED  IN  NGCO 
1L  ***' 

GO  TO  4 
TYPE  ' 

TYPE  *,'***  COLUMN  SIZE  LESS  THAN  2  (MINIMI’?!)  ATTEMPTED  ***' 

***  CORRECT  COLUMN  SIZE  *** 

CALL  '’RCCHK 

IF(NGHCOL.CT.M)GO  TO  2 
IF (NGHCOL.LT. 2 )G0  TO  3 
RETURN 
END 
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SUBROUTINE  CONSTS(A,B) 

C 

THIS  SUBROUTINE  ALLOWS  THE  USER  TO  INPUT  TWO  ARBITRARY 
CONSTANTS  TO  BE  USED  IN  THE  MATCHING  ALGORITHM. 

TYPE  ' 

TYPE  *,*WHAT  VALUE  OF  CONSTANTS  (A,  B)  DO  YOU  WISH  TO  USE' 

TYPE  * , ' FOR  THE  MATCHING  ALGORITHM? ' 

TYPE  ' 

TYPE  2 

FORMAT(5X,'A  MATCHING  CONSTANT  =  ',$) 

ACCEPT  *, A 
TYPE  3 

FOEMAT(5X, 'B  MATCHING  CONSTANT  =  ',$) 

ACCEPT  *,B 

TYPE  ' 

TYPE  *, 'HERE  IS  WHAT  YOU  HAVE  INPUT:' 

TYPE  ' 

***  DISPLAY  THE  VALUE  OF  THF,  CONSTANTS  *** 

TYPE  ' A  MATCHING  CONSTANT  =  ' ,A 
TYPE  *,'B  MATCHING  CONSTANT  -  ',B 

***  VERIFY  THE  CORRECT  RESPONSE  *** 

CALL  VERIFY (ANSWER) 

C 

IF( ANSWER. F.Q.  'NO'  )CO  TO  1 
WRITE  (6,*)  '  ' 

URITE  (6,*)  '***  VALUE  OF  CONSTANTS  FOR  MATCHING  ALGORITHM  ***' 
WRITE  (6,*)  '  ' 

WRITE  (6,*)  'A  MATCHING  CONSTANT  =  ',A 
WRITE  (6.*)  'B  MATCHING  CONSTANT  -  ',B 
WRITE  (6,*)  '  ' 

RETURN 

END 
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SUBROUTINE  THRESH(T) 


c 

C  THIS  SUBROUTINE  ALLOWS  THE  USER  TO  INPUT  A  THRESHOLD 

C  VALUE  USED  TO  COMPARE  THE  DISPARITY  LABELS  FOR  THE 

C  MATCHING  ALGORITHM. 

C 

1  TYPE  *, '  ' 

TYPE  *, 'WHAT  VALUE  OF  THRESHOLD  DO  YOU  WISH  TO  USE' 
TYPE  *, 'TO  COMPARE  THE  DISPARITY  LABELS?' 

TYPE  ' 

TYPE  2 

2  FORMAT(5X, 'DISPARITY  LABEL  THRESHOLD  =  ',S) 

ACCEPT  *,T 

TYPE  ' 

TYPE  * , 'HERE  IS  WHAT  YOU  HAVE  INPUT:' 

TYPE  ' 

***  DISPLAY  THE  VALUE  OF  THRESHOLD  *** 

TYPE  *, 'DISPARITY  LABEL  THRESHOLD  “  ',T 

***  VERIFY  THE  CORRECT  RESPONSE  *** 

CALL  VERIFY (ANSWER) 

C 

IF ( ANSWER. EO. 'NO' )CO  TO  1 
'•/RITE  (6,*)  '  ' 

WRITE  (6,*)  '***  THRESHOLD  FOR  DISPARITY  LABELS  ***' 
WRITE  (6,*)  '  ' 

WRITE  (6,*)  'DISPARITY  LABEL  THRESHOLD  =  ' ,T 
WRITE  (6,*)  '  ' 

RETURN- 

END 
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SUBROUTINE  UDPROB(P,A,B,T) 

C 

C  THIS  SUBROUTINE  UPDATES  THE  INITIAL  PROBABILITIES  DETERMINED 

C  BY  SUBROUTINE  INPROB.  THESE  UPDATED  PROBABILITIES  ARE  BASED 

C  ON  THE  CONSISTENCY  OF  THE  LABELS  OF  CAN DT DATE  NODES  WITHIN 

C  A  CERTAIN  NEIGHBORHOOD  SPECIFIED  BY  THE  USER.  IF  THERE  ARE 

C  MANY  NODES  WITHIN  A  CERTAIN  NEIGHBORHOOD  WITH  SIMILAR  LABELS, 

C  THE  PROBABILITY  OF  A  MATCH  FOR  THAT  LABEL  INCREASES. 

C 

INCLUDE  ' COMMO N . FTN ' 

VIRTUAL  P(N,M) 

COMMON  /IPS  I /  IPKNT1 

COMMON  /RECl/  QL( ( (2*(N-4 ) )/3)/2  ) 

COMMON  /NBHOOD/  NGHROW ,  NGIICOL,  NGHRWH ,  NCHCLH 
INTEGER  QKNT , PKNT , PROW 
D  WRITE  (6,*)  '***  ENTER  UDPROB  ***' 

PROW  =  (2*(N-4 ) )/3  +  3 
MDRTST  =  NGHROW  +  I 
MDCTST  =  NGHCOL  +  1 
DO  50  ITER* 1,10 
D  WRITE  (6,*)  '  ' 

D  l TRITE  (6,*)  0 *******★***★&★*★************ 9 

D  WRITE  (6,*)  '*  *' 

D  WRITE  (6,*)  '*  ITERATION  NUMBER  ' , ITER, '  *’ 

D  WRITE  (6,*)  '*  *' 

D  WRITE  (h,*)  '****************************' 

DO  50  J-1.IPKNT1 

***  INITIALIZE  0(L)  AND  0(L*)  *** 

NLBLS1  =  P( 3, J) 

DO  10  JJ-1.NLBLS1 
QL(JJ)  =  0 
CONTINUE 
QLSTR  -  0 

***  DETERMINE  NEIGHBORHOOD  FOR  LABEL  CONSISTENCY  *** 

NR0W1  -  P( 1 , J) 

NC0L1  -  P(2 , J) 

NRWMIN  -  NROWI  -  NGHRWH 
IF(NRWMIM.LE.O)NRWMIN  -  1 
NRWMAX  -  NROWI  +  NGHRWH  -  MOD(MDRTST, 2 ) 

MCLMIN  -  NC0L1  -  NGHCLH 
IF(NCLMIN. LE. 0 )NCLMIN  *  1 
NCLMAX  -  NC0L1  +  NGHCLH  -  M0D(MDCTST, 2 ) 

C 

NINPRW  -  PROW  +  1 
MAXPRW  -  PROW  +  NLBLS1 
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MAXRW1  -  2*NLRLS 1  +  3 

***  TEST  EACH  CANDIDATE  NODE  (K  NOT  *  J)  *** 


DO  20  K-1.IPKNT1 
IF(K.EO.J)C0  TO  20 
QKNT  -  0 
PSUM  -  0 
NRWFLG  -  0 
NCLFLG  =  0 

***  TEST  FOR  CANDIDATE  NODES  WITHIN  CONSISTENCY  NEIGHBORHOOD  *** 

NR0W2  =  P( 1 , K) 

NC0L2  =  P(2,K) 

IF  (  NR0W2 .  GE .  NR  WHIN .  AND .  NROW2  .  LE .  NR'  ,’MAX  )  NRWFLG  =  1 
IF(NC0L2 .GE. NCLMIN.AND.NCOL2 .LE. NCLMAX)  NCLFLG  =  1 
IF(NRWFLG.EQ.O. OR. NCLFLG. EQ.O)GO  TO  20 

***  UPDATE  MO-MATCH  CONSISTENCY  PROPERTY  0(L*)  *** 

QLSTR  =  QLSTR  +  P(N,K) 

LBRFLG  =  0 
LBCFLG  =  0 
NLBLS2  =  P(3,K) 

MAXRW2  «  2*MLBLS2  +  3 

***  TEST  LABELS  OF  CANDIDATE  NODES  FOR  CONSISTENCY  *** 

DO  20  11*4 ,MAXRW1 ,2 
PKNT  *  PROW 
QKNT  =  QKNT  +  1 
DO  20  12=4 ,MAXRW2 ,2 
PKNT  *  PKNT  +  1 

***  DETERMINE  LABEL  DIFFERENCES  *** 

LBLRDF  *  ABS(P(I 1 , J)  -  P(I2,K)) 

LBLCDF  =  ABS(P(I1+1 ,J)  -  P(I2+1,K)) 

***  TEST  LABEL  DIFFERENCES  AGAINST  THRESHOLD  *** 

IF(LBLRDF.LE.T)  LBRFLG  -  1 
IF ( LBLCDF. LE.T)  LBCFLG  -  1 
IF(LBRFLG.EQ.O. OR. LBCFLG. EQ.0)G0  TO  15 

C  ***  UPDATE  MATCH  CONSISTENCY  PROPERTY  O(L)  *** 

C 

QL(QKNT)  -  QL(QKNT)  +  P(PKNT,K) 
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c 

15 


LSRFLG  -  0 
LBCFLC  «  n 
CONTINUE 


20 
C 

C  ***  UPDATE  LABEL  PROBABILITIES  *** 

C 

10  -  0 

DO  30  I -MINPRW, MAXPRW 
10  -  IQ  +  1 

P(I,J)  -  ?(I,J)*(A  +  3*QL(IQ)) 

PSUM  =  PSUM  +  P(I,J) 

30  CONTINTJE 

C 

C  ***  UPDATE  MO-MATCH  PROBABILITY  *** 

C 

P(N,J)  »  P(N , J) *(A  +  3*QLSTR) 

PSUM  -  PSUM  +  P(N, J) 

C 

C  ***  OBTAIN  NEW  LABEL  PROBABILITIES  *** 

C 

DO  40  I*MINPRW , MAXPRW 
P(I,J)  -  P(I,J)/?SUM 
40  CONTINUE 

C 

C  ***  OBTAIN  NEB-7  NO-MATCH  PROBABILITY  *** 

C 

P(N, J)  -  P(N,J)/PSUM 
C 

D  WRITE  (6,*)  '  ' 

D  WRITE  (6,*)  'NEW  LABEL  PROBABILITIES:' 

D  WRITE  (6,*)  ' - ' 

D  DO  45  I-MIKPRW, MAXPRW 

D  WRITE  (6,*)  J,')  -  ',P(I,J) 

D45  CONTINUE 

D  WRITE  (6,*)  '  ' 

D  WRITE  (6,*)  'NEW  NO-MATCH  PROBABILITY:' 

D  WRITE  (6,*)  ' - 

D  WRITE  (6,*)  'P(',IT,',',J,')  -  \P(N,J) 

D  WRITE  (6,*)  '  ' 

50  CONTINUE 

RETURN 
END 
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SUBROUTINE  MTALG2 (MTAERR) 

TYPE  MTALC2  MOT  AVAILABLE  AT  THIS  TIME  ***' 

RETURN 

END 


SUBROUTINE  MTALG3 (MTAF.RR) 

TYPE  *,'***  MTALG3  NOT  AVAILABLE  AT  THIS  TIME  ***' 

RETURN 

END 

SUBROUTINE  MTALG4 (MTAERR) 

TYPE  *,'***  MTALG4  NOT  AVAILABLE  AT  THIS  TIME  ***' 

RETURN 

END 


SUBROUTINE  MTALC 5 (MTAERR) 

TYPE  *,'***  MTALG5  MOT  AVAILABLE  AT  THIS  TLME  ***' 

RETURN 

END 
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SUBROUTINE  MPLST(?) 


C 

C  THIS  SUBROUTINE  DETERMINES  THE  POINTS  IN  LMAGE  2  WHICH  ARE 

C  MATCHED  WITH  THOSE  IN  IMACE  1.  IF  THE  PROBABILITY  OF  ANY 

C  NODE  IS  GREATER  THAN  OR  EQUAL  TO  0.7,  THAT  POINT  IS  DEFINED 

C  TO  BE  MATCHED.  THE  POINT  IN  IMAGE  2  WHICH  IS  MATCHED  TO 

C  THAT  IN  IMAGE  1  IS  DETERMINED  BY  ADDING  THE  CORRESPONDING 

C  LABEL  TO  THE  POINT  IN  IMAGE  1  (THE  INTERESTING  POINT).  AFTER 

C  ALL  THE  MATCHED  POINTS  ARE  DETERMINED,  THEY  ARE  LISTED  ALONG 

C  WITH  SOME  MATCH  STATISTICS. 

C 

INCLUDE  'COMMON. FT N' 

VIRTUAL  P(N,M) 

COMMON  /IPS1/  I  PENT 1 
COMMON  /IPS2/  IPKNT2 
MINKOW  -  (2*(N-4))/3  +  4 
MPKNT  *=  0 
WRITE  (6,*)  '  ' 

WRITE  (6,*)  '  HERE  IS  THE  LIST  OF  MATCHED  POINTS:' 

WRITE  (6,1) 

1  F0RMAT(1X,67('-' )) 

DO  10  J=I , IPKNT1 
NLBLS  *  P(3, J) 

LRLKNT  -  2 

MAXROW  -  MINROW  +  NLBLS  -  1 
DO  10  I-MINROW, MAXROW 
LBLKNT  -  LBLXNT  +  2 

***  TEST  FOR  MATCHED  POINTS  *** 

IF(P(I,J).LT.0.7)G0  TO  10 

MPKNT  ■  MPKNT  +  I 

***  DETERMINE  COORDINATES  OF  MATCHED  POINT  IN  IMAGE  2  *** 

IPROW  -  P(1,J) 

IPCOL  -  P(2 , J) 

LX  »  P (LRLKNT, J) 

LY  -  P(LBLKNT+1 , J) 

MPROW  -  IPROW  -  LX 

MPCOL  -  I°COL  -  LY 

C 

WRITE  (6,5)  J, IPROW, IPCOL, MPROW, MPCOL 

5  F0RMAT(2X, 'IP( ' , 13, ' ):  NODE( ' , 13 , ' , ' , 13, ' )  ON  IMAGE  1  - >  NODE( 

l', 13, ',',13,')  ON  IMAGE  2') 

WRITE  (6,6)  LX, LY 

6  F0RMAT(5X, 'LX  -  ',I3,5X,'LY  -  ',13) 

10  CONTINUE 
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WRITE  (6,*)  '  ' 

WRITE  (6,*)  '  ***  MATCH  STATISTICS  ***' 

WRITE  (6,11) 

11  FORMAT( 1X,51('-')) 

WRITE  (6,*)  '  NUMBER  OF  INTERESTING  POINTS  IN  IMAGE  1  -  '.IPKNT1 

l /RITE  (6,*)  '  NUMBER  OF  INTERESTING  POINTS  IN  IMAGE  2  -  '.IPKNT2 

WRITE  (6,*)  '  NUMBER  OF  MATCHED  POINTS  -  ' .MPKNT 

WRITE  (6,*)  '  NUMBER  OF  UNMATCHED  POINTS  -  ' , IPKNT1-MPKNT 

WRITE  (6,*)  '  ' 

RATIO  -  FLOAT(MPKNT)/FLOAT(IPKNTI ) 

WRITE  (6,*)  '  PERCENTAGE  MATCHED  -  '  .RATIOMOO.O 
l /RITE  (6,*)  '  ' 

RETURN 

END 
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Appendix  F_:  Image  Display  Sect  Ion 

This  appendix  contains  the  FORTRAN  source  listing  for  the  Image 
Display  Section  of  program  DIDA. 


SUB  ROUT  I NE  IMGDSP(  IMGE  RR ,  IMGE  .'ID  ) 

THIS  SUBROUTINE  ALLOWS  THE  USER  TO  DISPLAY  AN  IMAGE  ON  A  CRT 
USING  THE  RAMTEK  DRIVER.  THE  USER  IS  ASKED  WHICH  IMAGE  DISPLAY 
OPERATION  IS  DESIRED.  THAT  OPERATION  IS  THEN  PERFORMED. 

COMMON  /FILE/  LUN 

COMMON  /RBUFF/  IPAR(A) , IOSTAT(2) 

WRITE  (6,*)  '***  ENTER  IMGDSP  ***' 

***  DEFINE  IMAGE  SIZE  *** 

CALL  IMGSZE 

***  ENTER  THF,  LOGICAL  UNIT  NUMBER  AND  FILE  NAME  OF  THE  IMAGE 
FILE  TO  BE  INPUT  *** 


TYPE  */  ' 

TYPE  *, 'ENTER  THE  LOGICAL  UNIT  NUMBER  AND  FILE  NAME  FOR  THE' 
TYPE  *, 'IMAGE  YOU  WISH  TO  DISPLAY: ' 

CALL  FLUFND 

***  OPEN  THE  LMAGE  FILE  *** 

CALL  OPNOLD 

DETERMINE  THE  LOGICAL  UNIT  NUMBER  FOR  THE  RAMTEK  DRIVER  *** 

LUNRM  -  LUN  +  1 
IF(LUNRM.EQ.5)LUNRM  -  7 
IF (LUNRM. GT. 10)LUNRM  -  1 

***  ASSIGN  LUNRM  TO  THE  RAMTEK  DRIVER  *** 

CALL  ASNLUN( LUNRM, 'RM:',0) 

***  SELECT  THE  IMAGE  DISPLAY  OPERATION  DESIRED  *** 

C 

CALL  DSPSEL(LUNRM ,  IMGERR,  IMGE  NT)) 

IF( IMGERR.EO. 1 .OR. IMGEND.EQ. 1 )GO  TO  10 
C 

RETURN 
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***  CLOSE  THE  IMAGE  FILE  *** 


C 

C 

C 

10 

c 


CALL  CLOSKP(IMGERR) 

RETURN 

END 


7 

] 

1 


SUBROUTINE  RMIOER( IOB , IER) 

C 

C  TIHS  SUBROUTINE  WRITES  AN  ERROR  MESSAGE  IF  AN  ERROR  OCCURS  WHEN 

C  USING  THE  RAMTEK  DRIVER. 

C 

BYTE  IOB 

TYPE  10, IER, IOB 

WRITE  (6,10)  IER, IOB 

10  FORMAT( / , '  ***  RAMTEK  10  ERROR  MESSAGE  ***',/, 

1'  It  DIRECTIVE  STATUS  -  ',14,/,'  It  IOSTAT  -  ',14,/) 

RETURN 

END 


noon 


SUBROUTINE  DSPS£L(LUN, DSPERR, DSPEWD) 

THIS  SUBROUTINE  ALLOWS  THE  USER  TO  SELECT  THE  IMACE  DISPLAY 
OPERATION  DESIRED.  THE  IMAGE  DISPLAY  IS  THEM  PERFORMED. 


1 


5 


10 


20 


30 


AO 


50 

60 

70 


INTEGER  DSPERR,  DSPEND, DSPNBR 
TYPE  *, 

'ENTER  THE  NUMBER  CORRESPONDING  TO  THE  IMAGE  DISPLAY' 
'OPERATION  YOU  WISH  TO  PERFORM:' 


TYPE  * 

TYPE  * 

TYPE  * 

TYPE  * 

TYPE  * 

TYPE  * 

TYPE  * 

TYPE  * 

TYPE  * 

TYPE  * 

TYPE  * 

TYPE  * 

TYPE  * 

TYPE  5 

F0KMAT(5X, 'IMAGE  DISPLAY  NUMBER 
ACCEPT  *, DSPNBR 


1.  DISPLAY  BLACK  AND  WHITE  IMAGE' 

2.  DISPLAY  COLOR  IMAGE' 

3.  DISPLAY  INTERESTING  POINTS  ON  A' 
BLACK  AND  WHITE  IMAGE' 

A.  DISPLAY  INTERESTING  POINTS  ON  A' 
COLOR  IMAGE ' 

5.  NONE  YET' 

6.  TERMINATE  IMAGE  DISPLAY  OPERATIONS' 

7.  TERMINATE  PROGRAM  EXECUTION' 


\S) 


IF(OSPNRR.LT. 1 .OR. DSPNBR.GT. 7)G0  TO  100 
GO  TO(10,2O,3O,A0, 50, 60, 70)DSPNBR 
ICOLOR  -  0 

CALL  RAMST(LUN. ICOLOR, DSPERR) 

IF(DSPERR.EQ. 1 )RETURN 

CALL  LMDSP1(LUN,ISCALE, DSPERR) 


RETURN 
ICOLOR  -  1 

CALL  RAMST(LUN, ICOLOR, DSPERR) 
IF(DSPERR.EQ. 1 )RETURN 
CALL  IMDSPKLUN,  ISCALE, DSPERR) 
RETURN 


ICOLOR  -  0 

CALL  RAMST(LUN, ICOLOR, DSPERR) 

IF(DSPERR. EQ. 1 )RETURN 
CALL  IMDSP2(LUN, DSPERR) 

RETURN 
ICOLOR  »  1 

CALL  RAMST(LUN, ICOLOR, DSPERR) 

IF(DSPERR.EQ. 1 )RETURN 
CALL  IMDSP2(LUN, DSPERR) 

RETURN 

TYPE  *,'***  OPTION  5  HOT  AVAILABLE  AT  THIS  TIME  ***' 
GO  TO  1 
RETURN 
DSPEND  -  1 
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I 
I 

RETURN 

1100  TYPE  ' 

TYPE  *,'***  INVALID  OPERATION  NUMRER' .DSPNBR, '  ATTEMPTED  *** 
GO  TO  I 
END 

I 
I 
I 
1 

1 
1 

1 
1 

1 

1 
I 
I 


I 
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SUBROUTINE  RAHST(LUN,  ICOLOR,  RAMERR) 


THIS  SUBROUTINE  INITIALIZES  THE  VIDEO  SCREEN  USING  THE  RAMTEK 
DRIVER.  IT  ALSO  INITIALIZES  THE  VIDEO  LOOKUP  TABLE  (VLT). 

INCLUDE  'COMMON. FTN' 

COMMON  /RBUFF/  IPAR(6), I0STAT(2 ) 

DIMENSION  IVLT(256),IMBUF(260) 

LOGICAL*!  IBYTE 

EQUIVALENCE  (IMBUF( 5 ) , IVLT( 1 ) ) , (IOSTAT( 1 ) , IBYTE ) 

INTEGER  RAMERR 

WRITE  (6,*)  '***  ENTER  RAMST  ***' 

***  INITIALIZE  VIDEO  LOOKUP  TABLE  *** 

IMBUF(l)  -  "2400 
IMBUF(2 )  -  "1400 
IM  BUF  (  3  )  -  0 
IM3UF(4)  -  514 

***  INITIALIZE  REMAINDER  OF  TABLE  *** 

IF  (ICOLOR  .EO.  0)  GO  TO  20 

***  SET  VLT  TO  COLOR  VALUES 

DO  30  I  -1,32 
IVLT(I)  -  0 
IVLT(I+32)  -  "17 
IVLTU+64)  -  "7417 
IVI,T(I+96)  -  "7400 
IVLT(I+128)  -  "7560 
IVLT( 1+160)  -  "7760 
IVLT(I+1 92 )  -  "3760 
IVLT(I+224)  -  "360 
0  CONTINUE 

IVLT(257)  -  0 
GO  TO  40 

***  SET  TO  BLACK  AND  WHITE 

0  DO  10  1-1,16 

DO  10  J-1,16 

IVLT(16*(I-1)+J)  -  273*(I-1 ) 

0  CONTINUE 

IVLT(257)  -  4080 

***  INITIALIZE  OIO  BUFFER  *** 
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40  CALL  GETADR(  I  PAR ,  LMRUF) 

IPAR(2 )  -  IM BUF ( 4 )  +  ft 
IPAR(3)  -  0 

***  SEND  INITIALIZATION  PARAMETERS  TO  RAMTEK  DRIVER  *** 

CALL  WT0I0("4 10,  LUK,  2,3, 1 OSTAT ,  I  PAR  ,  RA*1E  RR  ) 
IF(RAMERR.EQ. 1)RAMFRR  -  0 
IF  (  RAME  RR.OE.O  )RETURN 

***  WRITE  RAMTEK  ERROR  MESSAGE  *** 

CALL  RMIOER(IRYTE, RAMERR) 

RAMERR  *  1 
C 

RETURN 

END 
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SUBROUTINE  IMDSP 1  (LUU ,  ISCALF. ,  IMDERR) 


THIS  SUBROUTINE  DISPLAYS  A  BLACK  AND  I^Itr  IMACE  OM  A  CRT  US  INC 
THE  RAMTEK  DRIVER. 

I NCL UDE  ' COMMON . FIN ' 

COMMON  /BUF/  IOBUFR(L,M) 

COMMON  /INBUF/  IX (8) , IMTBUF(M) 

COMMON  /IMAGE/  IMCROW , IMGCOL 
LOGICAL* 1  IOBUFR 
INTEGER  RECNUM 

I /RITE  (6,*)  '***  ENTER  IMDSP1  ***' 

I  -  1 

ISCALF  =  L 
TYPE  *,'  ' 

TYPE  *, 'DO  YOU  WISH  TO  SCAJ  L  THE  IMAGE  UP  "0  A  SIZE  OF  ' 

TYPE  *,'(512X512)  FROM  ITS  PRESENT  SIZE?' 

TYPE  ' 

TYPE  * , ' IF  YOU  DO,  TYPE  YES.  OTHERWISE,  TYPE  NO. ' 

TYPE  *, '  ' 

TYPE  1 

FORMAT( 5X, ' ANSWER  -  ',$) 

ACCEPT  2 .ANSWER 
F0RMAT(A3) 

CALL  ANSCHK( ANSWER) 

IF(ANSWER.EO. 'YES' )ISCALE  •  0 
DO  10  RECNUM- l.U'GROW 

***  IIvPUT  AN  IMAGE  ROW  INTO  THE  INPUT  BUFFER  *** 

CALL  IMPUT(RECNUM,  I ,  IMDERR) 

IF(IMDERR.EO. 1 )RETURN 

***  PERFORM  BYTE-TO-WORD  NUMBER  CONVERSION  *** 

DO  5  J-l , IMGCOL 
INTBUF(J)  -  IOBUFR(l.J) 

IF ( I NT3UF ( J ) . LT. 0 ) INTBUF ( J )  -  INTBUF(J)  +  256 
CONTINUE 

***  SEND  IMAGE  ROW  TO  RAMTEK  DRIVER  *** 

CALL  RA1  FTT(LUM,  ISCALE, RECNUM  ,  IMDF.RR) 

IF( IMDERR. EO. 1 ) RETURN 

CONTINUE 

***  CLOSE  THE  IMAGE  FILE  *** 
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CALL  CLOSK?(IMDERP.) 


RETURN 

END 
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SUBROUTINE  RAMWT ( LHN ,  ISCALF. .RF.CNUM , RAMERR ) 


THIS  SUBROUTINE  WRITES  ONE  ROW  OF  AN  IVAOE  TO  THE 
VIDEO  SCREEN. 

INCLUDE  'COMMON. FTN' 

COMMON  /IMAGE/  IMGROU , IMGCOL 
COMMON  /RBUFF/  IPAR( 6 ) , IOSTAT( 2 ) 

COMMON  /IMBUF/  IX(8), INTBUF(M) 

DIMENSION  LMBUF(M+1 0) 

LOG ICAL*1  IBYTE 

EQUIVALENCE  (IM3UF(9) , INTBUF( 1 ) ) , ( IOSTAT( 1 ) , IBYTE) 
INTEGER  REGNUM .RAMERR 

***  CHECK.  TO  SEE  IF  THE  PICTUE  IS  TO  BE  SCALED 


ISCALV  =  0 

IF( I SCALE  .EQ.  1 )  GO  TO  10 

IF ( IMCROW  .LE.  123)  GO  TO  20 

ISCALF  =  2 

ISCALV  =  "401 

GO  TO  10 

ISCALE  «  4 

ISCALV  =  "1002 


***  SET  UP  THE  RAMTEK  INSTRUCTION  SET  *** 


IMBUF ( 1 )  =  "5003 
D1BUF(2)  =  "2300 

IMBUF ( 3 )  =  ( 540  -  ( IMGCOL*I SCALE) )/? 

IMBUF(4)  =  (512  -  ( IMGROty* I S CALC ) ) / 2  +  (RECNUM*ISCALE) 
IMPUF(5)  -  IMBUF (3 )  +  (IMGCOL*ISCALr )  -  1 
IMBUF(6)  **  IMBUF(4)  +  (ISCALE-1  ) 

IMBUF (  7  )  =  0 
IM3UF(8)  «*  ISCALV 
IM BUF (  9  )  =  2* IMGCOL 


-  IS  CALF. 


***  CHECK  IF  INITIAL  WRITE  *** 

CALL  OETADRCIPAR, IMBUF) 

IPAR(2 )  -  IMBUF(9)  +  IP 
IPAR(3)  =  0 

***  WRITE  OUT  THE  IMAGE  *** 

GALL  WTQI0("4 10, LUN, 2 , 3 , IOSTAT, IPAR, RAMERR) 
IF (RAMERR.EQ. 1)RAME RR  -  0 
IF  (RAMERR  .GE.  0)  RETURN 
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***  WRITE  ramtkk  error  message 

CALL  RMIOER( IBYTE , RAMERR) 
RAMERR  =  1 


*** 
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SI! BROUT IME  IMDSP2  (LUNRM ,  IMDERR) 

THIS  SUBROUTINE  WRITES  AN  IMAGE  TO  THE  RAMTEK  DRIVER,  THEN 
OVERLAYS  THE  INTERESTING  POINTS  OF  AN  INTERESTING  POINT  SET 
ON  THE  DISPLAYED  IMACE. 

INCLUDE  ' COMMON . FTN ' 

COMMON  /IF I LEI/  LUNIPS 

COMMON  /CVFILF./  LUNC'J 

COMMON  /IPS/  IPKNT, IPR(M) , IPC(M) 

WRITE  (6,*)  '***  ENTER  LMDSP2  ***' 

LUKCW  =  LUNRM 


***  DISPLAY  THE  SELECTED  IMAGE  USING  THE  RAJITEK  DRIVER  *** 

CALL  IMDSP l (LUNRM , ISCALE, IMDERR) 

IF (IMDERR. EO . 1 )RETURN 

TYPE  *, '  ' 

TYPE  *, 'ENTER  THE  LOGICAL  UNIT  NUMBER  AND  FILE  NAME  OF  THE' 

TYPE  *, ' SET  OF  INTERESTING  POINTS  YOU  WISH  TO  DISPLAY.' 

CALL  IF  1  FLU 

***  OPEN  THE  INTERESTING  POINT  SET  FILE  *** 

CALL  OPNIF1 

***  READ  THE  NUMBER  OF  INTERESTING  POINTS  *** 

READ  (LUNIPS, 1)  IPKNT 
P0RMAT(I3) 

***  INPUT  THE  INTERESTING  POINT  LOCATIONS  *** 

DO  10  1=1 .IPKNT 

READ  (LUNIPS, 2)  IPROW.IPCOL 

FORMAT(2I3) 

IPR(I)  =  IPR  O'; 

IPC(I)  =  IPCOL 
l)  CONTINUE 

***  WRITE  THE  INTERESTING  POINTS  ON  THE  RAMTEK  IMAGE  DISPLAY  *** 

CALL  RAHIP(LUNRM, ISCALE, IMDERR) 

***  CLOSE  THE  INTERESTING  POINT  SET  FILE  *** 

CLOSE(UNIT-LUNIPS) 

C 
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RETURN 

END 


I 

I 

I 

I 


1 

1 

I 

I 

I 

I 

I 
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Sun  ROUTINE  RAMIP(LUN,  ISCALE, RAMERR) 

C 

THIS  SUBROUTINE  WRITES  THE  INTERESTING  POINTS  ON  THE  IMAGE 
PREVIOUSLY  DISPLAYED  BY  SUBROUTINE  RAM’VT. 

INCLUDE  'COMMON. FTN' 

COMMON  /IPS/  IPKNT, IPR(M) , IPC(M) 

COMMON  /RBIJFF/  I?AR(6) ,IOSTAT(2 ) 

COMMON  /IMAGE/  LMGROL’ , IMGCOL 
DIMENSION  IMBUF (512) 

LOGICAL  *  1  IBYTE 
EQUIVALENCE  (IOSTAT( 1 ) .IBYTE) 

INTEGER  RAMERR 
DO  10  I  *  l.IPKNT 

***  SET  UP  THE  RAMTEK  INSTRUCTION  SET  *** 

IMBUF (  1 )  =*  "5003 
LM BUF ( 2 )  «  "300 

IMBUF(3)  =  (640-(IMGCOL*ISCALE))/2  +  (IPC(I)-l )*ISCALE-1 
IMBUF(4)  =  (512-(IMGROW*ISCALE))/2  +  (IPR(I)-l )*ISCALE-1 
IMBUF ( 5 )  =  IM BUF ( 3 )  +  2 
IMBU  F ( 6 )  -  IMBUF( 4)  +  2 
IMBUF(7)  -  0 
IMBUF(8)  *  18 
DO  20  J-1,9 
IMBUF(S+J)  »  256 
3  CONTINUE 

***  SET  UP  WRITE  STREAM  *** 

CALL  GETADR(IPAR, IMBUF) 

IPAR(2 )  -  IMBUF ( 8 )  +  16 
IPAR(3)  -  0 

***  WRITE  OUT  THE  IMAGE  *** 

CALL  WTQIO("4 10.LUN.2 , 3 , IOSTAT, IPAR, RAMERR) 

IF  (RAMERR  .EO.  1)  RAMERR  «  0 
IF  (RAMERR  .LT.  0)  GO  TO  30 
D  CONTINUE 

RETURN 

***  WRITE  RAMTEK  ERROR  MESSACE  *** 

C 

30  CALL  RMIOER(IBYTE, RAMERR) 

RAMERR  -  1 
C 

RETURN 
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Appendl_x  £:  By  te-to-Word  dumber  Conversion 

When  an  8-bit  nunher  is  read  by  the  computer  (in  this  case,  a  DEC  PDP 
11/45  minicomputer  operating  under  the  RSX-1 1M  operating  system)  and  stored 
in  a  byte  storage  location,  it  is  stored  as  shown  below: 

SIGN  |  MSB _ LSB 

I  I  I  T  I  f  I  I  I 

I _ I _  I _ I _ I _ I _ I _ I _  I 

7  |  6'  5  4  3  2  1  O' 

If  the  sign  bit  is  a  "1",  the  number  is  considered  to  be  negative.  If 
it  is  "0"  (zero),  the  number  is  positive.  Thus,  positive  numbers  up  to 
01111111  =*  127,  and  negative  numbers  down  to  10000000  =  128,  can  be  stored. 
To  make  the  numbers  negative  (say  -1),  it  is  necessary  to  add  the  2's 
complement  to  the  number  to  be  negated.  For  example,  for  +1  (represented 
as  00000001),  the  corresponding  negative  number  (-1)  is  not  represented  as 
10000001,  as  might  be  expected,  but  as  the  2's  complement  of  00H00001. 
This  formed  by  inverting  all  the  bit  positions  (0->l,  l->0)  and  adding  1. 
Thus,  -1  -  11111110  +1  -  11111111,  -2  -  11111110,  -3  -  11111101,  and  so 
forth. 

Now  consider  the  mnner  in  which  the  intensity  data  is  input.  For 
numbers  between  0  and  +127,  there  is  no  error.  However,  the  number  +128  is 
input  as  10000000.  The  computer  interprets  this  not  as  the  smallest 
negative  number  (-1),  but  the  largest  (-128).  Now  consider  the  largest 
positive  number  which  can  be  input  (255).  When  attempting  to  store  this 
number,  it  is  represented  as  1111 1111  on  the  image  file  (which  is  the 
binary  representation  of  255).  As  mentioned  above,  the  computer,  since  it 
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also  considers  possible  negative  number  inputs,  interprets  11111111  as  -1, 
the  smallest  negative  number.  Thus,  the  conversion  process  works  backward 
from  what  might  be  expected.  If  the  number  input  is  255,  it  will  be 
internally  stored  in  the  computer  as  -1.  Therefore,  256  must  be  added  to 
the  value  to  obtain  the  correct  number.  Similarly,  254  will  be  stored  as 
-2.  Again,  adding  256  restores  the  correct  value. 

The  way  this  conversion  process  works  internally  is  that  the  number  is 
stored  in  a  16-bit  integer  word  when  equivalenced  with  the  byte  array 
value.  Thus,  the  number  255  (stored  as  -1  =  11111111  in  the  byte  location) 
becomes  llllllllllllllll,  the  16-bit  representation  of  -1,  when 
equivalenced  to  a  16-bit  integer  word.  When  the  16-bit  number  256  is  added 
to  this,  the  following  results: 

II  1  1  l  1  1  1  1  l  1  1  1  1  1  l  1  (-1) 

+  |  0000000010000000  (+2  56) 

_l _ 

1|0  000000011111111  (+255) 

Since  the  1  at  the  leftmost  position  is  lost,  the  16-bit  numerical  result 
is  255,  the  desired  number.  Thus,  the  conversion  algorithm  is  quite 
simple: 

1.  Equivalence  the  8-bit  byte  array  to  a  16-bit  word  array  after 
the  intensity  values  are  read. 

2.  Test  the  16-bit  word  to  see  if  it  is  less  than  zero. 

3.  If  the  16-bit  word  is  less  than  zero,  add  256  to  it. 

4.  If  the  16-bit  word  is  greater  than  or  equal  to  zero,  leave  it  as 

is. 
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Appendix  11 :  NVL  Ha ca  Rase  Tane-to-Disk  Conve rslon  Program 


This  appendix  contains  the  FORTRAN  source  program  used  to  convert  the 
NVL  data  base  to  a  disk  file  acceptable  for  input  to  program  DIDA. 


BYTE  MTST 

LOGICAL* 1  IAN5W 

INTEGER*  2  MTST  AT (  2  )  ,HTPARM(  A  ) 

BYTE  MTIU!F(4500) 

EOUIVALENCE  (MTST, MTSTAT) 

IF LAG  =  0 

ICNT  -  1 

TYPE  1000 

ACCEPT  2000, IANSW 

TYPE  1010 

ACCEPT  2010.NUMREC 

CALL  ASNLUN( 1 , ' MT : ' , 0 ) 

CALL  ASNLrJN(  2 , '  SY :  ' ,  0  ) 

CALL  QIO  ("1400, 1,  ,  ,MTST,  ,*1TDS) 

12  IF(MTST)11,12,13 
C 

C  1  MEANS  SUCCESFUL  COMPLETION 

C  0  MEANS  OPERATION  STILL  PENDING 

C  -1  MEANS  UNSUCCESFUL  COMPLETION 

C 

1 1  CONTINUE 

13  CONTINUE 

WRITE( 5 , 1 01 )MTST,  MTSTAT( 2 ) 

101  FORMAT('ATT',2I5) 

CALL  WTqiO("2400, 1,1, ,MTST) 

CALL  WTQI0("2500, 1,1, ,MTST,0) 

17  CONTINUE 

CHECK  REWIND  BIT  TO  SEE  IF  TAPE  IS  REWOUND 
2520  -  SENSE  TAPE  CHARACTERISTICS 

CALL  WTQI0("2 520, 1,1,, MTST, IU) 

IF(IAMD(IU, "1000) .NE.O)  GO  TO  17 

FIND  ADDRESS  OF  3UF  TO  SEND  TO 
MAGTAPE  DRIVER. 

CALL  GETADR (MTPARM ,  MTBUF )  ^ 

MTPARM( 2 )— 4  500 
5  IASV-1 

OPEN(UNIT-2 , NAME* 'DK: [ 1 0, 20] TERAIN. IMG' , FORM- 'UNFORMATTED' , 
1  TYPE -'NEW' .ACCESS- ' DIRECT ' ,RECORDSIZE-12S,MAXREC-5 12 , 
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2  ASSnciATEVARIABLE=IASV) 

IF(NUMREC.NE. 1 )CALL  WTQIO("1000, 1,1, ,MTST, MTPA RM ) 

C 

C  READ  A  LOGICAL  BLOCK  (OCTAL  CODE  =*  1000) 

C 

10  CALL  WT0I0("1 000, 1,1, ,MTST, MTPARM) 

IF(MTST.NF..  1  )TYPE* , ' IOSTATUS  =  '  ,MTST 
IFCMTST.NE. l)C0  TO  300 

IF(IANSW.EO. 'Y' )TYPE*, '  BYTES  READ  -  ' ,MTS?AT(2 ) 

IFLAG=0 

DO  16  M=2 , 4096,2 
IF(MTBUF(M).GE.0)GO  TO  14 
MT  RUF  ( M  )  ='1T  BUF  (  M  )  /  2 
MTBUF ( M ) =MTBUF ( M ) - 1 2  8 
^GO  TO  20 

14  MTBUF  (  M  )  =MTBUF  (  M  )  /  2 

20  IF ( MTBUF (M-l ),EQ. 1 ) MTBUF (M)=MTBUF(M)—1 28 

16  CONTINUE 

DO  15  1=1 , XUMREC 

WRITE(2  ' IASV)  (MTRUF(  II),  11  =  1 024*1-1 022, 1024*1,2) 

15  CONTINUE 
GO  TO  10 

300  IF LAG  =  IFLAG  +1 

C 

C  AFTER  EACH  END  OF  FILE  CLOSE  CURRENT  OUPUT  FILE  AND  OPEN  ANOTHER  ON 

C 

C 

CLOSE( UNIT-2) 

TYPE*,' EOF', ICNT 
IF ( ICNT. EO . 20 )GO  TO  999 
IF(IFLAG.EO,2)  GO  TO  999 
ICNT  -  ICNT  +1 
GO  TO  5 

999  STOP 

1000  F0RMAT(1X, 'DO  YOU  WANT  BYTES  READ  PRINTED?  [Y/N]  '$) 

1010  FORMAT(  IX, 'ENTER  NUMBER  OF  RECORDS  (1  OR  4)  '/'  NUMP.EC  *  ',$) 
1100  F0RMAT(80A1) 

2000  FORMAT(Al) 

2010  FORMAT(I3) 

END 
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19.  KEY  WO  EDS  (Contfnuo  on  reverse  «i<fe  If  necessary  end  idonttfy  by  block  number) 

Disparity  Analysis  Matching  Algorithms  Correspondence  Problem 

Time-Varying  Imagery  Interest  Operators  Dynamic  Imagery 

Image  Processing  Interesting  Points 


20.  ABSTRACT  ^Continue  on  reverse  side  If  necessary  and  identify  by  block  rumber) 

An  interactive  program  (called  program  DIDA)  was  developed  to  perform  dis¬ 
parity  analysis  of  time-varying  imagery.  The  program  consists  of  four  sections: 
(1)  image  operations;  (2)  interesting  point  selection;  (3)  interesting  point 
matching;  and  (4)  image  display.  Three  data  bases  were  obtained:  (1)  a 
20-frame  sequence  of  images  from  a  terrain  board  of  the  U.S.  Army  Night  Vision 
Laboratory;  (2)  an  18-frame  sequence  of  various  moving  objects  from  the 
University  of  Minnesota;  and  (3)  a  33-frame  sequence  of  images  of  a  traffic 
scene  from  the  University  of  Hamburg.  • — _ _ _________ 
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— ;  Each  of  the  four  program  sections  were  tested.  Image  operations  included 
printing  image  intensities,  and  image  file  creation  and  deletion.  Three 
interest  operators  were  employed  in  the  interesting  point  selection  section: 

(1)  simple  variance;  (2)  directed  variance  (the  Moravec  Operator);  and  (3) 
edged  variance.  The  number  of  interesting  points  selected  was  found  to  be 
inversely  proportional  to  the  interest  operator  threshold.  A  relaxation-labeling 
matching  algorithm  was  used  in  the  interesting  point  matching  section  to  match 
interesting  points  from  two  images.  Very  poor  matching  results  were  obtained. 
Image  displays  included  black-and-white  and  color  images  with  and  without  the 
interesting  points  overwritten.  Photographs  were  taken  of  both  cases^ 
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